-- Logs begin at Mon 2022-10-17 16:57:15 UTC, end at Mon 2022-10-17 17:59:30 UTC. -- Oct 17 17:29:36.430466 dv-cinder-861609-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 17 17:29:36.441627 dv-cinder-861609-1-smb devstack@keystone.service[81842]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 17:29:36 2022] *** Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: nodename: dv-cinder-861609-1-smb Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: machine: x86_64 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: clock source: unix Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: pcre jit disabled Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: detected number of CPU cores: 4 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: current working directory: / Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: detected binary path: /usr/bin/uwsgi-core Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: your processes number limit is 47680 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: your memory page size is 4096 bytes Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: detected max file descriptor number: 2048 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: lock engine: pthread robust mutexes Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: thunder lock: enabled Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 17 17:29:36.443158 dv-cinder-861609-1-smb devstack@keystone.service[81842]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 17:29:36.482780 dv-cinder-861609-1-smb devstack@keystone.service[81842]: Python main interpreter initialized at 0x55ad65d689c0 Oct 17 17:29:36.482780 dv-cinder-861609-1-smb devstack@keystone.service[81842]: python threads support enabled Oct 17 17:29:36.482780 dv-cinder-861609-1-smb devstack@keystone.service[81842]: your server socket listen backlog is limited to 100 connections Oct 17 17:29:36.482780 dv-cinder-861609-1-smb devstack@keystone.service[81842]: your mercy for graceful operations on workers is 90 seconds Oct 17 17:29:36.483149 dv-cinder-861609-1-smb devstack@keystone.service[81842]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 17:29:36.483224 dv-cinder-861609-1-smb devstack@keystone.service[81842]: *** Operational MODE: preforking *** Oct 17 17:29:36.483510 dv-cinder-861609-1-smb devstack@keystone.service[81842]: *** uWSGI is running in multiple interpreter mode *** Oct 17 17:29:36.483510 dv-cinder-861609-1-smb devstack@keystone.service[81842]: spawned uWSGI master process (pid: 81842) Oct 17 17:29:36.483693 dv-cinder-861609-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 17 17:29:36.485100 dv-cinder-861609-1-smb devstack@keystone.service[81842]: spawned uWSGI worker 1 (pid: 81854, cores: 1) Oct 17 17:29:36.485100 dv-cinder-861609-1-smb devstack@keystone.service[81842]: spawned uWSGI worker 2 (pid: 81855, cores: 1) Oct 17 17:29:36.485100 dv-cinder-861609-1-smb devstack@keystone.service[81842]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 17:29:40.691331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:29:40.691331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Oct 17 17:29:40.692157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:29:40.692157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Oct 17 17:29:40.692274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:29:40.692274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: from cryptography.utils import int_from_bytes Oct 17 17:29:40.692274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:29:40.692274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: from cryptography.utils import int_from_bytes Oct 17 17:29:40.741361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:29:40.741549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:29:40.741683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:29:40.741771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:29:40.741843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] command line args: [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:29:40.741913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] command line args: [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:29:40.741990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:29:40.742066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:29:40.742130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ================================================================================ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:29:40.742197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ================================================================================ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:29:40.742313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] admin_token = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_dir = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_dir = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_source = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.742985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_source = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] debug = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] debug = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.743977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_config_append = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_config_append = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.744937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_dir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_dir = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.745954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.746963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.747927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.748935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.749103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.749257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] publish_errors = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.749400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] publish_errors = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.749837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.749913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] standard_threads = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] standard_threads = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.750935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_journal = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_journal = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_json = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_json = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_stderr = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_stderr = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.751978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_syslog = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.752056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_syslog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.752208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.752340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:29:40.752423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.752494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.752675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.752797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.752885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.752959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.753910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.754862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.755949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.756932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.757920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.758983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.759984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.760937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.761932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.762995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.763989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.764915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.765948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.766900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.767916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.768974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.769950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.770888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771153 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.771969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.772942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.773981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.774879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.775925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.776923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.external = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.external = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.777967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.password = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.password = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.token = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.token = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.778845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.779954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.780970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.781996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.782905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.783871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.784959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.785923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.786974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.787976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.788890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.789903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.790940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.791979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.792094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.792206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.792599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.793888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.794939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.795967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.796903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.797957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.798996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.799920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.800898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.801989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.802918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.803965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.804989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.805970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.806883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.807997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.808251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.808540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.808690 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.808798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.808913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.809851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.810904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.811919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.812945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.813973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.814897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.815920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.816950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.817994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.818914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.819923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820153 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.820945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.821972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.822900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.823965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.824985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.825946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.826997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:29:40.827647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:29:40.827647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:29:40.855055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.855262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.855402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.855486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.855671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.855760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.863818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.864066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.892110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.892345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.892691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.892902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.945967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.946277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.994406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.994563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.994965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:40.995215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.155977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.156059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.156137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.156373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.179994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.180806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.191844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.192312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.204774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.205956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.206087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.206169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.206291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.206390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 17:29:41.222788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.222998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 17:29:41.223335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.223457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.223681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 17:29:41.223774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 17:29:41.223901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.223982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 17:29:41.224310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.224800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.225061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.234119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.234396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.234661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.234785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.234984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.235171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.235264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.235545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.241951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.242566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.244914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.245102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.245410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.245615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.245828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.245976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246740 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.246876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.247749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.248000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.248275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.248526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.270776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.271677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.272240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.272533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.273141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.273420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.277402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.277715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.277999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.278281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.278536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.278818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.284425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.284702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.285122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.285408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.290491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.290788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.291403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.291961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.292902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.293173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.308335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.308654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.309089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.309404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.312819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.313265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.316107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.316397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.316520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.316797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.320635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.321019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.323831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.324221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.327357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.327555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.327698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.327826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.327951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.328865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.344683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.344812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.344965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.345075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.345193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.345284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.345473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.345614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.352351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.352500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.353936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.354173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.355497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.355621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.355772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.355919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.358407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.358664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.358664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.358931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.359730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.370932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.371030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.371220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.371400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.371503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.371634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.371759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.371949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.372848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.388531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.388841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.391468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.391792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.394441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.394655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.395879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.396153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.397347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.397621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.397744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.397890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.398034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.398303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.404434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.405910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.406188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.408788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.409900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.410025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.417543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.417834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.418030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.418121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.418259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.418382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.424929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.425214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.425337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 17:29:41.425483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.425631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.425760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.425922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.426943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.427884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.428629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 17:29:41.462737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad65d689c0 pid: 81854 (default app) Oct 17 17:29:41.462869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad65d689c0 pid: 81855 (default app) Oct 17 17:29:41.466246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676530-7b9f-4de1-85a8-5c5ebd140d67 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:41.466522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676530-7b9f-4de1-85a8-5c5ebd140d67 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:41.466789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676530-7b9f-4de1-85a8-5c5ebd140d67 None None] PATH_INFO: `/v3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:41.471054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Oct 17 17:29:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:29:48.347131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:48.347980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:48.348129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:48.355278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:29:48.361888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:48.362751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:48.362751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:48.442230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: INFO dbcounter [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] Registered counter for database keystone Oct 17 17:29:48.461777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:29:48.474042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writer thread running {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:29:48.668531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81854) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 17:29:48.668915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81854) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 17:29:48.729201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:48.731144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:48.875647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 17:29:49.346711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:49.418062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: INFO dbcounter [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] Registered counter for database keystone Oct 17 17:29:49.443728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:29:49.452592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writer thread running {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:29:49.581173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a867-e93e-44e8-939e-e6e0ab3a04d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:49.589805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:49.590551 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:49.590826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:49.591099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:49.600257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:49.653036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 17:29:49.653407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed862e82-cb8d-48c7-a68b-7976a4875426 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:49.664193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Oct 17 17:29:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:29:49.670966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:49.691007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1f554-a19b-4d67-b6fb-4ffb5d1b6521 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:49.696456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:49.697616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:49.697910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:49.698182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] PATH_INFO: `/v3/projects/a760cc568b8d4fdf85c6c5d207733585` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:49.700135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] RBAC: Authorizing `identity:get_project(project_id=a760cc568b8d4fdf85c6c5d207733585)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:49.753696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 17:29:49.754054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aee5f-9566-4251-b0e2-2fe3a83ae914 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:49.758709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:29:49 2022] GET /identity/v3/projects/a760cc568b8d4fdf85c6c5d207733585 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:29:51.858542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af720-e8fb-47cb-aa9d-4ca6ff07651b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:51.859084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af720-e8fb-47cb-aa9d-4ca6ff07651b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:51.859084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af720-e8fb-47cb-aa9d-4ca6ff07651b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:51.865554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:51.871496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:51.871944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:51.872034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:51.892717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:51.894249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:51.902818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 17:29:52.176956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005af720-e8fb-47cb-aa9d-4ca6ff07651b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:52.200110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005af720-e8fb-47cb-aa9d-4ca6ff07651b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:52.206220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:52.206831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:52.207113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:52.207384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:52.216572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:52.218399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813266-0a77-4d21-a439-94877cb827f7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:52.227784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Oct 17 17:29:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:29:52.234453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:52.244054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bf2b2-c0f3-464b-8f7f-ff2ce843462d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:52.250921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:52.251561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:52.251833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:52.252102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] PATH_INFO: `/v3/users/9fdce8f8b50f420382f53907829ee9fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:52.253643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fdce8f8b50f420382f53907829ee9fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:52.255526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cb7e9-4e7d-4458-b4ed-d13fc1501231 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:52.257071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Oct 17 17:29:52 2022] GET /identity/v3/users/9fdce8f8b50f420382f53907829ee9fe => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:29:54.580452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a7-7ebb-459b-be2e-accb8e6f4559 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:54.581036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a7-7ebb-459b-be2e-accb8e6f4559 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:54.581036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb8a7-7ebb-459b-be2e-accb8e6f4559 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:54.582642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:54.588111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:54.588572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:54.588673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:54.608008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:54.609650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:54.649323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63b36-d857-4cf1-9ed2-b1bd86f06a35 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:54.649571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63b36-d857-4cf1-9ed2-b1bd86f06a35 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:54.649957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a63b36-d857-4cf1-9ed2-b1bd86f06a35 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:54.651404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:54.657098 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:54.657465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:54.657773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:54.696305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:29:54.700048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG passlib.handlers.bcrypt [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81855) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 17:29:54.700441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG passlib.handlers.bcrypt [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81855) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 17:29:54.749320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:54.751217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:54.853858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:29:54.972217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:54.999005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.088959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f221f-7562-416f-853a-8a2eaf12aa9e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.116998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.126423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.126879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.127158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.127417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.140717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:29:55.149601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:29:55.150579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:29:55.151385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:29:55.157233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.224480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfb220-7830-47bb-a1b2-88f8c31d0853 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.226786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.242397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.260970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e02b94-e0c0-442c-9987-9d139a4a8477 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.264584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.265464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.265772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.266044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.267019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.268447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.280522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:29:55.280522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:29:55.280522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [parameters: {'id': '622ad2d2adba494cb4286cc5800584be', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 17:29:55.280522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:29:55.299396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 17:29:55.300470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 17:29:55.301810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 17:29:55.303062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 17:29:55.304504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:29:55.306117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'id': '622ad2d2adba494cb4286cc5800584be', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 17:29:55.307142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:29:55.308237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.309285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 8/15] 10.222.0.62 () {60 vars in 1137 bytes} [Mon Oct 17 17:29:55 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:29:55.310322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.310322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.310322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.310322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.310606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:29:55.310606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.310606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.310919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.322730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 8/16] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:29:55.328813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.412125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee20cb-6855-4160-a5ec-c5d837063db1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.433448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a2b3-2cbf-4029-b883-d709c057faff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.454085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.454952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.455221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.455487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.471835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.472473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.472751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.473021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] PATH_INFO: `/v3/users/9fdce8f8b50f420382f53907829ee9fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.473753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.474198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9fdce8f8b50f420382f53907829ee9fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.475228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.475622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.477184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:29:55 2022] GET /identity/v3/users/9fdce8f8b50f420382f53907829ee9fe => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:29:55.482838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:29:55.492392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:29:55.493357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:29:55.494349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:29:55.494349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:29:55.494349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:55.494349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:29:55.500491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.501187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.524189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.589406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e321ad1-5b3a-4005-9efd-99a92cfe82c9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.606419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f78a3-d2b1-41b2-adf4-9dc2ab97bec7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.626697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.627403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.627683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.627960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.629132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.630634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.632203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:29:55.638335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:55.648476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.649202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.649486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.649790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.650485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:29:55.650835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.652424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7826d-b2f0-4fe4-afab-02d101852a2d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.670268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:29:55.728944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:55.752926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9cba-dad4-4c6e-9e02-b5861f6ff16e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:55.791399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:55.792082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:55.792429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:55.792827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] PATH_INFO: `/v3/domains/default/users/9fdce8f8b50f420382f53907829ee9fe/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:55.795230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9fdce8f8b50f420382f53907829ee9fe, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:55.796763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63bc9c-90e0-4bf0-bdb9-dab328213416 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:55.912692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 11/21] 10.222.0.62 () {58 vars in 1361 bytes} [Mon Oct 17 17:29:55 2022] PUT /identity/v3/domains/default/users/9fdce8f8b50f420382f53907829ee9fe/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:29:58.299404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea242ab-a714-4063-b82d-e5f1a4593854 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.300445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea242ab-a714-4063-b82d-e5f1a4593854 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.300934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea242ab-a714-4063-b82d-e5f1a4593854 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.302515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:58.308642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5534e-c900-4dc3-905d-99a651283623 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.309467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5534e-c900-4dc3-905d-99a651283623 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.309979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5534e-c900-4dc3-905d-99a651283623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.338695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7cf5534e-c900-4dc3-905d-99a651283623 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:58.340629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7cf5534e-c900-4dc3-905d-99a651283623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:58.431450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:29:58.531548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48597de-78da-4ec5-ba3f-f0df2b5c633c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.532171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48597de-78da-4ec5-ba3f-f0df2b5c633c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.532656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48597de-78da-4ec5-ba3f-f0df2b5c633c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.534202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:58.539969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9d40-e955-46a8-a05d-f1b2c7448f3b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.540479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9d40-e955-46a8-a05d-f1b2c7448f3b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.540941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9d40-e955-46a8-a05d-f1b2c7448f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.566689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9efd9d40-e955-46a8-a05d-f1b2c7448f3b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:58.568191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9efd9d40-e955-46a8-a05d-f1b2c7448f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:58.588810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbaf3b-8cef-4d10-afff-cff338a0f1db None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.589778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbaf3b-8cef-4d10-afff-cff338a0f1db None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.590317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbaf3b-8cef-4d10-afff-cff338a0f1db None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.592389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 13/25] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:29:58.598118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.598410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.598668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.621818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:58.623067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:58.696585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:58.715991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:29:58.732620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d8f4-4f12-44ff-8f38-0dc870894e87 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.733296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d8f4-4f12-44ff-8f38-0dc870894e87 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.733905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d8f4-4f12-44ff-8f38-0dc870894e87 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.738272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:29:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:29:58.744167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.744669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.745125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.778370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:29:58.781177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:29:58.786837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 14/28] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:29:58.808937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:58.828001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:58.903626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 15/29] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:29:58.944728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0d81-b673-41c2-ab2e-85725f283bb7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:58.992451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:58.993406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:58.993912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:58.994368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:58.995266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:58.997160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:59.139379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 15/30] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Oct 17 17:29:58 2022] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:29:59.148727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.219702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.275240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561f8b5-28ba-4f3e-9a59-81e7db565ec4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:59.306307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:59.314813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:59.316714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:59.317012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:59.317264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:59.318064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:59.319632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:59.327633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:59.345945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 16/31] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Oct 17 17:29:59 2022] POST /identity/v3/roles => generated 225 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:29:59.352955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.459761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38aed9a-0c4f-4cd6-8419-2d2cd9518caa None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:59.487870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef100b9-e895-485f-ad5b-ea79e37566ce None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:59.530569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:59.531387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:59.531671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:59.531945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:59.545618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:59.547373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:29:59.566793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:29:59.567885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:29:59.568860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:29:59.568860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:29:59.568860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:29:59.571296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 17/32] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:29:59.581621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.583233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:59.584134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:59.584657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:59.585132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:59.617343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:29:59.627193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:29:59.628076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:29:59.628816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:29:59.630165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 16/33] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:29:59.637991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:59.639293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.713283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2af03-7c7d-4b65-843d-ae4fb1f60fe3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:59.759713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:59.760344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:59.760625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:59.760997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:59.761747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:29:59.762054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:59.764273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:59.785802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0d9c7-f92c-4fa3-ab5b-e50ccc1790fb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:29:59.790891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 18/34] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:29:59.795342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.822175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:29:59.830184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:29:59.831214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:29:59.831680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:29:59.832169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:29:59.833269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:29:59.833812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:29:59.835623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:29:59.851305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 17/35] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:29:59.857742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:29:59.974584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466f5e-3236-4389-81b9-9bce4a04fe19 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.014032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.015042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.015532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.015993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] PATH_INFO: `/v3/users/9fdce8f8b50f420382f53907829ee9fe` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.017861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] RBAC: Authorizing `identity:get_user(user_id=9fdce8f8b50f420382f53907829ee9fe)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.019536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.021735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 18/36] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:29:59 2022] GET /identity/v3/users/9fdce8f8b50f420382f53907829ee9fe => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:00.026669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:00.069572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1ce4-626f-4288-8699-677c9b21105a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.071703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:00.092494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:00.107789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.108413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.108692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.108961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.109679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.111144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cbaa7-8f69-4ce8-840f-ac2d72e2a5bf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.140552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296df5-a184-4a20-95d1-6bc1394e0518 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.146913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:29:59 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:30:00.146913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771e70-0815-4eed-83b8-19189ce70076 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.146913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771e70-0815-4eed-83b8-19189ce70076 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.146913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771e70-0815-4eed-83b8-19189ce70076 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.146913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 20/38] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:00.151735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7457c7-2e24-4388-b1df-d06412d2229e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.151735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7457c7-2e24-4388-b1df-d06412d2229e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.152038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7457c7-2e24-4388-b1df-d06412d2229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.171876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3f7457c7-2e24-4388-b1df-d06412d2229e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:00.173140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3f7457c7-2e24-4388-b1df-d06412d2229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:00.191173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.191835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.192114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.192385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.194122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.195834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.197920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 19/39] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:00.204351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:00.267357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 21/40] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:00.307042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3b53-2271-4f43-9f2b-8cd1e5ae4f68 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.307511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3b53-2271-4f43-9f2b-8cd1e5ae4f68 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.307672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3b53-2271-4f43-9f2b-8cd1e5ae4f68 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.320545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 22/41] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:00.320545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.320545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.320545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.346420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc580111-5670-4348-8ea4-90037efc5bce None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.348496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:00.351903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:00.385023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:00.399394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.400014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.400298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.400569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.401323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.domain.id=default, user.id=9fdce8f8b50f420382f53907829ee9fe) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:00.403117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.403600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.416646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 20/42] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Oct 17 17:30:00 2022] GET /identity/v3/role_assignments?user.id=9fdce8f8b50f420382f53907829ee9fe&scope.domain.id=default&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 530 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:00.488406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 23/43] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:00.579013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:00.700570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7affb-7abf-4544-86d1-aaa35b9b8337 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.736285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.736933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.737213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.737486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.738637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.740092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.742067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 21/44] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:00.747440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:00.764352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:00.767336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:00.828092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:00.856479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a61bd-4127-4f2d-bba5-b2b9cdc80fbf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.869007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90872dc-cf4b-4ba2-b4c1-49c1d93b6686 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:00.892543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.893171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.893457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.893764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.894444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.895988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107af96-75d3-45f2-b502-1745e6505a96 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.904562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:00.905177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:00.905454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:00.905787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:00.906517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:00.907859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e538e5-e39f-4b1f-85b2-8ffe1485de2d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:00.923236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 24/45] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:30:00 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:00.923486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 22/46] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Oct 17 17:30:00 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:03.099260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d5d0-7e73-4ed1-a453-4e64d09630e3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:03.100142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d5d0-7e73-4ed1-a453-4e64d09630e3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:03.100142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d5d0-7e73-4ed1-a453-4e64d09630e3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:03.102368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 25/47] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:03.108143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:03.108567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:03.108652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:03.128983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:03.130532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:03.201036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 23/48] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:03.476453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d5d0-7e73-4ed1-a453-4e64d09630e3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:03.555335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:03.598303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d5d0-7e73-4ed1-a453-4e64d09630e3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:03.635105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:03.635753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:03.636282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:03.636659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:03.637864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:03.639327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188fc82-4c2f-4a53-9d9d-35d5ac3b63c1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:03.640942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 26/49] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:03.650211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:03.707021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:03.758430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e974e3-3c78-4f89-aa32-421c8898e982 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:03.805217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:03.806213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:03.806667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:03.807102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:03.808700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:03.810214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c17a83-b1e9-4ee6-8c6f-879ccef1a258 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:03.841974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 24/50] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Oct 17 17:30:03 2022] POST /identity/v3/projects => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:06.025867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f76a-05f0-4876-9a7c-de0ee0efa476 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:06.026451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f76a-05f0-4876-9a7c-de0ee0efa476 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:06.026451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f76a-05f0-4876-9a7c-de0ee0efa476 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:06.027861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 27/51] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:06.033953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:06.034410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:06.034492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:06.056602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:06.058055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:06.147277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 25/52] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:06.424335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9f76a-05f0-4876-9a7c-de0ee0efa476 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:06.537167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9f76a-05f0-4876-9a7c-de0ee0efa476 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:06.575309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:06.575973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:06.576260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:06.578083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:06.578083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:06.579289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ec1b-9886-4389-9fd8-241bd7539daa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:06.580900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 28/53] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:06.586694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:06.618253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:06.693189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ba8e-2a99-4565-a419-617a2a696b31 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:06.730919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:06.731540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:06.731814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:06.732086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:06.732730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:06.734279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430842a1-f9e9-4282-bd57-74968895ef3d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:06.764281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 26/54] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:06 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:10.307292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6e48-ace2-4c8e-b5f5-b7c2ed5d6b99 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.307292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6e48-ace2-4c8e-b5f5-b7c2ed5d6b99 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.307292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6e48-ace2-4c8e-b5f5-b7c2ed5d6b99 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.308565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 29/55] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:10.314710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602838b-a544-4ef1-9e25-c88c7a920508 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.315643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602838b-a544-4ef1-9e25-c88c7a920508 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.316117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602838b-a544-4ef1-9e25-c88c7a920508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.321423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5bbc-b76e-44ea-8f4a-620baf30544b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.321988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5bbc-b76e-44ea-8f4a-620baf30544b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.322482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5bbc-b76e-44ea-8f4a-620baf30544b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.325189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 30/56] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:10.331491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913540-d0b6-4fe5-ab16-8a3d703351d5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.332045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913540-d0b6-4fe5-ab16-8a3d703351d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.332515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913540-d0b6-4fe5-ab16-8a3d703351d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.339535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:10.367651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a6913540-d0b6-4fe5-ab16-8a3d703351d5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:10.369285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6913540-d0b6-4fe5-ab16-8a3d703351d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:10.525558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 31/57] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:10.558685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9602838b-a544-4ef1-9e25-c88c7a920508 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:10.559844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9602838b-a544-4ef1-9e25-c88c7a920508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:10.584338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286283cb-d673-449a-bfeb-8435391f5072 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.584646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286283cb-d673-449a-bfeb-8435391f5072 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.584914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286283cb-d673-449a-bfeb-8435391f5072 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.586318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 32/58] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:30:10.592638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.592944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.597652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.640244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:10.643083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:10.685515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 27/59] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:10.687288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf7a7-47d9-4062-92a6-afb202ade1f4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.687781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf7a7-47d9-4062-92a6-afb202ade1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.688242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf7a7-47d9-4062-92a6-afb202ade1f4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.689728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 28/60] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:10.695421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:10.696059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:10.696536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:10.740653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:10.741894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:10.765027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 33/61] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:10.782015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:10.864693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 29/62] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:10.907172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.046597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.053652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.115753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96eabd-c278-4d77-b2db-19c8561ff34c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.179082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.183140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.185288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.187740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.243353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-64aec3ab-c962-4847-b35d-2420d8fca62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:11.248854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:11.249704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:11.250787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:11.253026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 34/63] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:11.256635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184e89-1515-4d63-86c8-13a3ecbe4e5d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.257094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184e89-1515-4d63-86c8-13a3ecbe4e5d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.257523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184e89-1515-4d63-86c8-13a3ecbe4e5d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.259039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 35/64] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:11.260008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184e89-1515-4d63-86c8-13a3ecbe4e5d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.274633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099577a-3091-4539-a9d5-c64fe55d25e1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.318498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.319222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.319612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.320303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.340620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:11.349146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:11.350748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:11.352858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 30/65] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:11.354732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.369616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.409571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184e89-1515-4d63-86c8-13a3ecbe4e5d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.437366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.454611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.455296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.455766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.456183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.468566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:11.474581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:11.475668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:11.476443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:11.478872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 36/66] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:11.480222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.492372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74df1c-6f4d-41a6-a7a0-b1cb17eaa358 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.534895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.535595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.535888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.536223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.549487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ee5b71d8-d32b-40a7-bdc5-d9089d17292f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:11.554410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:11.555545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:11.556390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 31/67] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:11.557141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.557141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.557339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.577337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:11.579209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:11.612550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e9e2-21e4-4fac-ba50-b540eaae34fc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.657353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.658770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.659809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.660116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.660398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.661081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:11.661397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:11.662902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:11.665221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 32/68] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:11.666115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.684346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 37/69] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:11.685872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.741912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.793070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbc450-8169-4d39-978a-edf7779abc89 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.817449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1827a-1c60-4f12-9313-537ee87ec661 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:11.846301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.846925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.847222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.847480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.848155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:11.848458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:11.850671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:11.860328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 33/70] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:11.861162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.892520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:11.892520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:11.892520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:11.892520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:11.892906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:11.892906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:11.892906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:11.909350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 38/71] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:11.915224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:11.947137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:11.990178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cad81-9c48-463f-80b4-d679bda5e18e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.029510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.030271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.030560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.030836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.031517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:12.031827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.032654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e8093-0ae8-4458-bbca-a7c4e2222156 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.033205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.041439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.043437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 34/72] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.044620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.072793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.073686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.074003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.074362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] PATH_INFO: `/v3/users/9fdce8f8b50f420382f53907829ee9fe` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.075564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] RBAC: Authorizing `identity:get_user(user_id=9fdce8f8b50f420382f53907829ee9fe)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.077032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.078676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 39/73] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:11 2022] GET /identity/v3/users/9fdce8f8b50f420382f53907829ee9fe => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.079458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.166558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90091d4-b0d8-4a53-a7e2-d64a495e5300 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.193210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.197034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fb1f-e70d-47bc-a3bc-1fd380490e4a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.206142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.206891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.207233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.207576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.226887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.228458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.230914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 35/74] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.230914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.251142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.252280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.252722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.253142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.261398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.262923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.264620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 40/75] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.269473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.332493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.356334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeada9f-7ca0-4e72-b82f-2f7a8b2e0aa5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.393072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.393739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.394026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.394302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.395461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.396926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.398748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 36/76] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.399323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.401035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639018-adf6-4ad1-81e5-b9cfd28ca13b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.436438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.437102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.437683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.437683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.438783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.441477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.442049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 41/77] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.442600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.456792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.515750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4794a9-3b19-4460-ab18-49553632d4a0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.552099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6768-33b4-4678-9b2c-06637e9e4094 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.552725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.553448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.553726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.554003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.555160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.556881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.558742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 37/78] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.563712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.564541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.589885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.590247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.590531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.590825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.592419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.593911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.595762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 42/79] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.596307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.679146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3efe4-00f0-4370-a3f6-31f3a4478502 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.695992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.706162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1440-1d89-47e7-aca4-c648f63598bd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.715480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.716200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.716537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.716815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.717985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.719436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.721087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 38/80] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.721877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.744591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.745332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.745697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.746492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.747180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.748679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.780193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 43/81] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:12 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:12.781043 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.828590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:12.870390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa608-35e1-4ed2-a4ae-22b7865499d8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:12.962596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:12.963887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:12.964181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:12.965424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] PATH_INFO: `/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:12.967421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] RBAC: Authorizing `identity:get_project(project_id=9c5deeb0422c45d4b2c6344fa98e32f6)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:12.969854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:12.972864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 39/82] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:12 2022] GET /identity/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:12.974133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:12.981328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67dc85-23e1-4ac0-a5f9-6ea29802fd60 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:13.047186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:13.049900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:13.050184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:13.050630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/9fdce8f8b50f420382f53907829ee9fe/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:13.055255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, user_id=9fdce8f8b50f420382f53907829ee9fe, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:13.057260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:13.081931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:13.084602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 44/83] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:12 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/9fdce8f8b50f420382f53907829ee9fe/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:13.084768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:13.194837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5889b-3b39-4458-be62-d0c2857c8754 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:13.292216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:13.292904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:13.293165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:13.293443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/df53393606f04e0f9cd00d0cc71d3e33/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:13.298493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, user_id=df53393606f04e0f9cd00d0cc71d3e33, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:13.300454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:13.341177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 40/84] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:12 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/df53393606f04e0f9cd00d0cc71d3e33/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:13.342514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:13.348899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:13.361610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f5fa1-dfcc-4c59-8730-29d1377e7a39 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:13.426089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:13.426852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:13.427832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:13.427832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/df53393606f04e0f9cd00d0cc71d3e33/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:13.433351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, user_id=df53393606f04e0f9cd00d0cc71d3e33, role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:13.435201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc3f48-1145-40f1-be0b-eac5d090db22 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:13.464459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 45/85] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:13 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/df53393606f04e0f9cd00d0cc71d3e33/roles/291c5a802e814346bb3421d0737828c8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:13.509893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970725d-ff39-4438-8b5e-6d00e81cfaa6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:13.544421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:13.566545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:13.567302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:13.567587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:13.567862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] PATH_INFO: `/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6/users/df53393606f04e0f9cd00d0cc71d3e33/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:13.579587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5deeb0422c45d4b2c6344fa98e32f6, user_id=df53393606f04e0f9cd00d0cc71d3e33, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:13.581107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716a992-4af0-4fdc-a4d1-c32a2d53f8f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:13.606154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 41/86] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:13 2022] PUT /identity/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6/users/df53393606f04e0f9cd00d0cc71d3e33/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:16.305286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212c3a-f1a9-45ca-bd8d-a63cd90a5613 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.305861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212c3a-f1a9-45ca-bd8d-a63cd90a5613 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.305861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212c3a-f1a9-45ca-bd8d-a63cd90a5613 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.307832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 46/87] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:16.315464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200f12-2226-46c7-a79e-ed71bd4ac27e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.315980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200f12-2226-46c7-a79e-ed71bd4ac27e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.315980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200f12-2226-46c7-a79e-ed71bd4ac27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.341979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-30200f12-2226-46c7-a79e-ed71bd4ac27e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:16.343383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-30200f12-2226-46c7-a79e-ed71bd4ac27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:16.458487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6c56-c3b9-4e6e-bc94-5a412a67436b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.458769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6c56-c3b9-4e6e-bc94-5a412a67436b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.459268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6c56-c3b9-4e6e-bc94-5a412a67436b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.461508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 47/88] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:16.468166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.468857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.469304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.502925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 42/89] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:16.504178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:16.505552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:16.572547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd594c-39fa-42ef-ad5d-23507a5e1359 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.573237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd594c-39fa-42ef-ad5d-23507a5e1359 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.573859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd594c-39fa-42ef-ad5d-23507a5e1359 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.576047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 43/90] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:16.583409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0351ab-7a10-4d2d-b8b6-632887c87bad None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.584600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0351ab-7a10-4d2d-b8b6-632887c87bad None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.585094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0351ab-7a10-4d2d-b8b6-632887c87bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.618156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bc0351ab-7a10-4d2d-b8b6-632887c87bad None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:16.619359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bc0351ab-7a10-4d2d-b8b6-632887c87bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:16.657855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 48/91] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:16.755853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 44/92] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:16.868858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:16.919218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e08b-3b66-4f49-b1a7-a8f681ecaf5f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.919873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e08b-3b66-4f49-b1a7-a8f681ecaf5f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.920344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e08b-3b66-4f49-b1a7-a8f681ecaf5f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.923843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 45/93] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:16.948860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236e81-6587-4960-aa2e-d50531d22aa4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:16.949607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236e81-6587-4960-aa2e-d50531d22aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:16.950115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236e81-6587-4960-aa2e-d50531d22aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:16.984573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fd236e81-6587-4960-aa2e-d50531d22aa4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:16.986176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fd236e81-6587-4960-aa2e-d50531d22aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:17.013619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.038648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.054764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacd77d-022c-4b56-99e6-1117765ec762 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.094084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 46/94] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:17.095400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdba8a-953f-4059-a086-41c336c78e88 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.095689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdba8a-953f-4059-a086-41c336c78e88 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.096228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdba8a-953f-4059-a086-41c336c78e88 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.098577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 47/95] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:17.099338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdba8a-953f-4059-a086-41c336c78e88 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.101914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.102785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.103196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.103598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.104982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:17.106876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9670-74e0-4103-b20e-82ba03bbf4e9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:17.108942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 49/96] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:17.114577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.114577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.114577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.143529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:17.145344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:17.224446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 50/97] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:17.225370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.293664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdba8a-953f-4059-a086-41c336c78e88 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.321689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.339537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.340857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.341340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.341803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.344254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1fd39-75bb-46c0-92c6-fc06082ad3cd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.353663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:17.359455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:17.360426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:17.361166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:17.363738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 48/98] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:17.364833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.391789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.391789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.391789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.391789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.418760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:17.425606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:17.426504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 51/99] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:17.427239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.437666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.555845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe9b0-492f-4488-b04e-15bf784f1aa1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.585163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b5e8-f08f-4f55-951f-920d87f8df7d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.593716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.594334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.594615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.594888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.595546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:17.597074 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:17.620549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.621189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.621458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.621821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.622526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:17.623065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:17.624611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:17.625444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 49/100] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:30:17 2022] POST /identity/v3/projects => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:17.626670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.634721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 52/101] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:17.646185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.646185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.746419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.768245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a74fb-2405-4a16-a1a0-b51e759e7720 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.781721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b53a-fa3f-4aa8-8adc-89fcbcbae29d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:17.814760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.815386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.815668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.816056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.828822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:17.829119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:17.829506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.829809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.830709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.830810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:17.831057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:17.832493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a08857ff-3a04-4c33-a9e1-a01d226c7e09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:17.834486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:17.835368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:17.836112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:17.836688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 53/102] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:17.838331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3668c-8cbf-49b7-955b-1473e278beff None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:17.838331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3668c-8cbf-49b7-955b-1473e278beff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:17.838331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3668c-8cbf-49b7-955b-1473e278beff None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:17.840468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 54/103] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:17.841049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3668c-8cbf-49b7-955b-1473e278beff None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.841787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 50/104] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:17.842403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:17.931201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:17.993439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3668c-8cbf-49b7-955b-1473e278beff None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.000839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322910-b1a4-4b9f-aa1b-e5676d94c485 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.034832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.035675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.035956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.036229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.037725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.038381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.038665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.038999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] PATH_INFO: `/v3/users/9fdce8f8b50f420382f53907829ee9fe` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.040252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] RBAC: Authorizing `identity:get_user(user_id=9fdce8f8b50f420382f53907829ee9fe)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.041685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.043563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 51/105] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/users/9fdce8f8b50f420382f53907829ee9fe => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:18.044358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.048914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:18.050834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4653304c-1993-4be5-b6b1-f45a1b5a0f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:18.055169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:18.056038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:18.056788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:18.058827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 55/106] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:18.060736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.061026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.061302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.084554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:18.085806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:18.159915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 56/107] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:18.160511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.193609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e9e4-4bbd-4217-aad9-79fa9734295e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.230379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.231112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.231394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.231666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.232420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:18.232803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.234381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.235020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.246647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 52/108] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:18.252290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.293699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33feb2b-7099-44da-b86e-20e06ba02230 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.338332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.339166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.344929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.344929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.345193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.345615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.345615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.345615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 57/109] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:18.345615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.389483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9493ee-de7c-4d27-a195-f2af4df1b9e3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.433895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.435503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.435798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.436079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.469607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f9d08-4a21-4655-a77e-c07871fc317e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.494484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.509801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.510360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.510746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.511171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.511884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:18.512192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.513852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.523285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 58/110] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:18.524027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.526254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.528782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.599699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.646556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a4355-b93e-43a8-a7a2-656dd1e119d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.648936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 53/111] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:18.649776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.687995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.688642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.688926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.689203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] PATH_INFO: `/v3/users/1a135e9a6c6e4240867133eb777bfa4a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.705060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] RBAC: Authorizing `identity:get_user(user_id=1a135e9a6c6e4240867133eb777bfa4a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.706831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.708664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 59/112] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/users/1a135e9a6c6e4240867133eb777bfa4a => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:18.709497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:18.766043 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.773450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee6c9b-700a-4ee0-87db-566824e5a0e6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.813141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.814142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.815047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.815545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.849883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd525b6b-affd-4eb0-a527-56d7f5cc5475 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:18.858086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:18.889939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:18.890941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:18.891551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:18.892014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:18.896403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:18.897918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:18.904230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:18.909747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:18.910816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:18.911730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:18.914052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 60/113] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:18.916442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.018450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 54/114] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:19.019255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.037110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438c1e0-0fb0-4d53-9abd-d1d007e4aa44 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.040368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.076622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.077643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.078076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.078367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.079542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.081316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.087287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 61/115] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:18 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.087287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.107304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.145201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57043f6-eeea-40a6-8143-00c5938f49b7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.190695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.191354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.191639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.191920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.193137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.194658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.196332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 55/116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.197534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.210571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710059-374f-4077-bb91-13baa7f357b8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.248107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.248756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.249042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.249321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.251734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.252700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.254746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 62/117] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.255524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.302062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.322079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6b5c-58a4-4b45-a559-df86583f0aea None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.361122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.361821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.362966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.362966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.363729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:19.364049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.365453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.367528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.377101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 56/118] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.378348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.384898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ecec-830e-47d4-8f0d-0a67bb50af9b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.423210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.423951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.424304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.424584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.425811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.427274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.428928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 63/119] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.435236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.494874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ef3e0-034a-4f0f-8aca-8076fe2e02e8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.532239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.533296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.533598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.533884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.547240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cd2e9-bd28-48da-8d4d-aa1acad7a1c6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.554890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.591819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.592850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.593143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.593425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.594544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=619912d46701490f8e45f6d01c2ee0bd, user.id=9fdce8f8b50f420382f53907829ee9fe) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:19.594867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.596878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.606578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 64/120] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/role_assignments?user.id=9fdce8f8b50f420382f53907829ee9fe&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.607762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.619610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.631617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.633546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.753123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9a29-d343-43f0-8e5e-bf2cee5ce697 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.768586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 57/121] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:19.775282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.797998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.799243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.799243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.799243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/1a135e9a6c6e4240867133eb777bfa4a/roles/a43d782ae6e24f1daed904ae6059cd34` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.801443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, user_id=1a135e9a6c6e4240867133eb777bfa4a, role_id=a43d782ae6e24f1daed904ae6059cd34)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.803221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.821446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 65/122] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:19 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/users/1a135e9a6c6e4240867133eb777bfa4a/roles/a43d782ae6e24f1daed904ae6059cd34 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:19.822500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:19.860845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.912367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:19.921365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea0ba-d504-47b2-b767-c95ad5a65862 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.965719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e45-c412-428d-a0c2-d9566105cb8d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:19.984496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:19.985335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:19.985744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:19.986030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] PATH_INFO: `/v3/users/df53393606f04e0f9cd00d0cc71d3e33` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:19.987421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] RBAC: Authorizing `identity:get_user(user_id=df53393606f04e0f9cd00d0cc71d3e33)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:19.989466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:19.991470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 58/123] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/users/df53393606f04e0f9cd00d0cc71d3e33 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:19.992151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.014286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.015339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.015820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.016278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.017036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] RBAC: Adding query filter params (role.id=291c5a802e814346bb3421d0737828c8, scope.project.id=619912d46701490f8e45f6d01c2ee0bd, user.id=df53393606f04e0f9cd00d0cc71d3e33) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:20.017356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.019035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964f4c4-56ab-48c2-8d97-c12dbc49b187 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.027404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 66/124] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/role_assignments?user.id=df53393606f04e0f9cd00d0cc71d3e33&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=291c5a802e814346bb3421d0737828c8 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:20.033437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65866cb-cd3c-4f32-acf5-70f28ae7aa34 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.033437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65866cb-cd3c-4f32-acf5-70f28ae7aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.033437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65866cb-cd3c-4f32-acf5-70f28ae7aa34 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.034696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 67/125] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:20.035535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65866cb-cd3c-4f32-acf5-70f28ae7aa34 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.152648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067448d0-fac0-43b4-bebb-b8cb473daf14 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.187053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:20.199821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65866cb-cd3c-4f32-acf5-70f28ae7aa34 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.204191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.205190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.205715 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.206188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.207664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.210305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79111a-3565-4ae8-b906-b95d4aab5532 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.212989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 59/126] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:19 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:20.219423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.219713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.220012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.247358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:20.250638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:20.253291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.254957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.255245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.255525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.283831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:20.343995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 60/127] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:20.344995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.361090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.363108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.474845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff989-5087-4254-ac88-ed6ba2b190cd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.496238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:20.507269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 68/128] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:20.513425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.514580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.515202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.515478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.515746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.516482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] RBAC: Adding query filter params (role.id=0cf9dc9265e6464b9f4900be70acd315, scope.project.id=619912d46701490f8e45f6d01c2ee0bd, user.id=df53393606f04e0f9cd00d0cc71d3e33) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:20.516785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.518942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.524628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 61/129] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:20 2022] GET /identity/v3/role_assignments?user.id=df53393606f04e0f9cd00d0cc71d3e33&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:20.636009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500390b3-4972-49bb-b776-77e230f3f32f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.649773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.679662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.680846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.680846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.680846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] PATH_INFO: `/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.682143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] RBAC: Authorizing `identity:get_project(project_id=9c5deeb0422c45d4b2c6344fa98e32f6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.683818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.686736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 69/130] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:20 2022] GET /identity/v3/projects/9c5deeb0422c45d4b2c6344fa98e32f6 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:20.694915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.700503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:20.782534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:20.823643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff256e8-ca81-42a9-a855-25fd6be6e4d2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.835333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf671e-8d04-4aaa-8a36-67764001c6db None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:20.863819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.864279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.864559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.864829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.866117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.868334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.869985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 62/131] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:20.872387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:20.873014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:20.873611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:20.873708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:20.874441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] RBAC: Adding query filter params (role.id=0cf9dc9265e6464b9f4900be70acd315, scope.project.id=9c5deeb0422c45d4b2c6344fa98e32f6, user.id=df53393606f04e0f9cd00d0cc71d3e33) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:20.875160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:20.876020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:20.876617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a15fb8-4406-4b57-9f99-53be44a6f757 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:20.893607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 70/132] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:20 2022] GET /identity/v3/role_assignments?user.id=df53393606f04e0f9cd00d0cc71d3e33&scope.project.id=9c5deeb0422c45d4b2c6344fa98e32f6&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:20.993161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:21.002367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db3e4-ab6d-41b2-8ae8-ea0bf2d97d12 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:21.047318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361213-35c1-4528-b856-5087df973921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:21.047972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361213-35c1-4528-b856-5087df973921 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:21.048335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361213-35c1-4528-b856-5087df973921 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:21.048703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361213-35c1-4528-b856-5087df973921 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:21.049543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361213-35c1-4528-b856-5087df973921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:21.051436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361213-35c1-4528-b856-5087df973921 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:21.080361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 63/133] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:20 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:30:22.120161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225447-ac18-42e8-8c50-b5317cb867d6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:22.120719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225447-ac18-42e8-8c50-b5317cb867d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:22.120914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225447-ac18-42e8-8c50-b5317cb867d6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:22.122336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 71/134] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:22.128876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:22.129325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:22.129405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:22.150239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:22.151561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:22.228920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 64/135] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:22.513720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e225447-ac18-42e8-8c50-b5317cb867d6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:22.625178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e225447-ac18-42e8-8c50-b5317cb867d6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:22.653675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:22.663295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:22.664250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:22.664728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:22.665206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:22.676213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:22.681299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:22.682206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:22.683032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:22.685290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 72/136] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:22.697599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:22.784797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:22.806047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf72b-edf5-4019-911d-f7c69b2824b3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:22.857563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:22.857563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:22.857563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:22.857563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:22.857968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:22.857968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:22.857968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:22.869678 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 65/137] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:22.874687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:22.984539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8cd7-8ffc-4ed7-9c1f-f9e39ab36c99 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:23.020012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:23.020824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.021182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.021527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] PATH_INFO: `/v3/users/1a135e9a6c6e4240867133eb777bfa4a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.022768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] RBAC: Authorizing `identity:get_user(user_id=1a135e9a6c6e4240867133eb777bfa4a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:23.024328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:23.026554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 73/138] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:22 2022] GET /identity/v3/users/1a135e9a6c6e4240867133eb777bfa4a => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:23.034969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:23.147107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fca43-1128-430e-abf0-887165f5607d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:23.192457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:23.193087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.193363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.193662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.206726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:23.265964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:23.267470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f6690-9c19-43f3-9fe7-e5b7f3c56bb0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:23.381927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 66/139] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:23.388015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:23.450201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:23.482569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766644c6-a3a5-4877-9f2e-27b98fa78b5c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.482858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766644c6-a3a5-4877-9f2e-27b98fa78b5c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.483151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766644c6-a3a5-4877-9f2e-27b98fa78b5c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.484679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 67/140] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:23.495253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.496135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.496438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.529616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:23.529616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:23.547709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3e0f-beed-48b3-9d9f-53b270f3ce95 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:23.615785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:23.616709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.617147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.617620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.618979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:23.621770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd9d2a-d528-409a-8e37-12b9fd13735e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:23.623498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 74/141] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:23 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:23.625077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fbb4-ee5d-4131-be1e-2c26adea8d51 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.625370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fbb4-ee5d-4131-be1e-2c26adea8d51 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.625667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fbb4-ee5d-4131-be1e-2c26adea8d51 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.627106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 75/142] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:23.628413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bb3d-b713-4062-9b47-c5de0b2f73c4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.628695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bb3d-b713-4062-9b47-c5de0b2f73c4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.628970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bb3d-b713-4062-9b47-c5de0b2f73c4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.630288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 76/143] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:23.634646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10ff3-ffac-497d-a3a8-c000a6eeef67 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.636358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10ff3-ffac-497d-a3a8-c000a6eeef67 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.636909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10ff3-ffac-497d-a3a8-c000a6eeef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.638798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:23.659389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ab10ff3-ffac-497d-a3a8-c000a6eeef67 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:23.660801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ab10ff3-ffac-497d-a3a8-c000a6eeef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:23.689619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 68/144] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:23.689619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:23.760118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 77/145] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:23.769605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.769605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.769605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.793614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:23.797765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:23.857612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0642-29db-44b0-a513-f7245c019de2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:23.897985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:23.900373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:23.900373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:23.900373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:23.901040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] RBAC: Adding query filter params (role.id=a43d782ae6e24f1daed904ae6059cd34, scope.project.id=619912d46701490f8e45f6d01c2ee0bd, user.id=1a135e9a6c6e4240867133eb777bfa4a) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:23.904630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:23.906174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:23.908243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:23.914329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 69/146] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:23 2022] GET /identity/v3/role_assignments?user.id=1a135e9a6c6e4240867133eb777bfa4a&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=a43d782ae6e24f1daed904ae6059cd34 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:23.935701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 78/147] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:23.976072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.044346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.044983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.107869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16789fbf-c360-4d5c-97b1-829dbd6bcd71 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.153881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.154478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.154478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.154691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.168841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:24.175725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:24.176588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:24.177478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:24.178155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 70/148] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:24.187663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.189080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558671d-d8ad-47b4-b6c0-60aea6de54fc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.232556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.233205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.233483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.233787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.235042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.236402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.238023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 79/149] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:24.238023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.289533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.302095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.308269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479f73-938d-4c50-bf80-22d6ea496c4f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.343965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.344589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.344869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.345143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.345855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:24.345956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d975e-637c-450a-8394-53d11c3a7c96 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.346159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.347552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.356363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 71/150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:24.357199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.383242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.383877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.384153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.384421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.394914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:24.400897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:24.402164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 80/151] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:24.406402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.475735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b57b-37d9-4d5c-8ae8-616008f83761 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.515626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.516247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.516523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.516856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.517520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.519071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.524689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4bf1-e01e-4877-8045-0d6a854a78c7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.537497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.541374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 72/152] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:24 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:24.541374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.564367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.581924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.582768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.583053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.583693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] PATH_INFO: `/v3/users/6f6503518a0c42c78fd0dd4792d303ba` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.603619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] RBAC: Authorizing `identity:get_user(user_id=6f6503518a0c42c78fd0dd4792d303ba)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.606288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.609238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 81/153] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/users/6f6503518a0c42c78fd0dd4792d303ba => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:24.614966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.669894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9018688-5a5b-4476-9945-4c9c68f3a42f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.710812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.711765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.712065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.712337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.713309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:24.713755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.715607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.728583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 73/154] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:24.734634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.739742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a3041-365e-4131-b612-1514718e5c86 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.787860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.788497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.788772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.789041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.793007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.793007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.795480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 82/155] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:24.800300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.828858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.844560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:24.867682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb824d-700e-4742-a6ba-6cea76c3399e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.914270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.914931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.915212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.915489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] PATH_INFO: `/v3/users/6f6503518a0c42c78fd0dd4792d303ba` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.916934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] RBAC: Authorizing `identity:get_user(user_id=6f6503518a0c42c78fd0dd4792d303ba)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.918421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.920116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 74/156] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/users/6f6503518a0c42c78fd0dd4792d303ba => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:24.924864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34586c-148e-482e-8d14-ce1a066803ca None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:24.926973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:24.969378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:24.970155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:24.970432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:24.970703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/6f6503518a0c42c78fd0dd4792d303ba/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:24.972626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, user_id=6f6503518a0c42c78fd0dd4792d303ba, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:24.974140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:24.992075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 83/157] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:24 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/6f6503518a0c42c78fd0dd4792d303ba/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:30:25.066578 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f853-3b4a-4948-bc87-f6673c54a1ac None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:25.107676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:25.108731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:25.109143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:25.109687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:25.111063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:25.112934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7fa6e-1d4f-4fe0-a8ed-8217aec07fec None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:25.115273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 75/158] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:24 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:25.123113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:25.242706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:25.251031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7557ec-bb99-4dfc-ae08-177e85f60608 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:25.298406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:25.299084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:25.299365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:25.299638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/6f6503518a0c42c78fd0dd4792d303ba/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:25.301847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, user_id=6f6503518a0c42c78fd0dd4792d303ba, role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:25.303328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6eb7-2d1f-4aa4-96d4-fd2c260dc820 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:25.319086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 84/159] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:25 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/6f6503518a0c42c78fd0dd4792d303ba/roles/291c5a802e814346bb3421d0737828c8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:26.912805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b713-0f80-46cc-8467-d408ed36a8ae None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:26.913353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b713-0f80-46cc-8467-d408ed36a8ae None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:26.913353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b713-0f80-46cc-8467-d408ed36a8ae None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:26.914889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 76/160] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:26.920463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929b39-6fcc-4ffc-b59a-0be66ffca2ed None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:26.920916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929b39-6fcc-4ffc-b59a-0be66ffca2ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:26.921006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929b39-6fcc-4ffc-b59a-0be66ffca2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:26.940709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ed929b39-6fcc-4ffc-b59a-0be66ffca2ed None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:26.941926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed929b39-6fcc-4ffc-b59a-0be66ffca2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:27.009013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002af09-7db9-4ff2-b451-95e3895138bf None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.009697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002af09-7db9-4ff2-b451-95e3895138bf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.010164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002af09-7db9-4ff2-b451-95e3895138bf None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.011800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 77/161] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:30:27.013943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 85/162] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:27.020152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a404-67d5-4578-9e6e-dd06ec0a715d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.023449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a404-67d5-4578-9e6e-dd06ec0a715d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.023449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855a404-67d5-4578-9e6e-dd06ec0a715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.040216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0855a404-67d5-4578-9e6e-dd06ec0a715d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:27.041865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0855a404-67d5-4578-9e6e-dd06ec0a715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:27.050372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:27.117393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 78/163] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:27.304208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208af2-01bc-4e72-97f0-4dffb63d2f4f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.304406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208af2-01bc-4e72-97f0-4dffb63d2f4f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.304691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208af2-01bc-4e72-97f0-4dffb63d2f4f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.306149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 86/164] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:27.311577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.311860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.312131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.331854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:27.332663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208af2-01bc-4e72-97f0-4dffb63d2f4f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.333028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:27.446923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 79/165] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:27.449607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.469175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:27.495385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208af2-01bc-4e72-97f0-4dffb63d2f4f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:27.539857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:27.542697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:27.543658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.544121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.545411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.571579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:27.580148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:27.581085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:27.582273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:27.582868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50e0f-e118-467c-a8de-ab652f592080 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:27.584476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 87/166] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:30:27.590557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.632179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:27.632629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.632910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.633181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.634332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:27.635862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce413c26-5f03-4187-a6c5-1434c7a252fb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:27.637451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 80/167] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:27.638667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3003e4a-2abd-4d7c-aae3-0643394fc2b0 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.639403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3003e4a-2abd-4d7c-aae3-0643394fc2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.639403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3003e4a-2abd-4d7c-aae3-0643394fc2b0 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.640572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 81/168] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:27.646591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.646879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.647158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.668400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:27.669759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:27.712940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc04bac-613b-4a55-887a-9f8a763e29dc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:27.758449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 82/169] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:27.759028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:27.759331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.759642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.759917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.760182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.760995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:27.761293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:27.762791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:27.773073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 88/170] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:27.778556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.791287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:27.847358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:27.885281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659eb9-45e6-4da1-bf3b-11c26c948578 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:27.906665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55891-7290-427a-90b6-b92db7e1e512 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:27.929399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:27.930724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.931203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.931666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.933002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:27.935212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:27.953916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:27.954781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:27.955342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:27.957025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:27.968325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 83/171] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:27 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:27.969005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:27.984489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:27.990603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:27.991530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:27.992363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 89/172] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:28.003146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.111676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.155744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80bedd-99bb-4c4a-aff5-924e099002b1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.155954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c54e3-b16c-4eff-87b1-458aea12dc6a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.187903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.201025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.201996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.202842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.203117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.203336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.203439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] PATH_INFO: `/v3/users/62b93961f8f34b7ba29ca3f1e2a57fea` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.203916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.204372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.205246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:28.205789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:28.208692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:28.223236 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] RBAC: Authorizing `identity:get_user(user_id=62b93961f8f34b7ba29ca3f1e2a57fea)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:28.223424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 90/173] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:28.224266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.225481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:28.227602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 84/174] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:27 2022] GET /identity/v3/users/62b93961f8f34b7ba29ca3f1e2a57fea => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:28.229718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.358733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50e5a-29ae-4b73-b96e-09c1f4615c49 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.385069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa1266-c581-4540-9a90-296d99cbc658 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.402612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.412709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.413604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.414337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.414745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.434928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:28.444363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:28.445302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:28.446123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:28.448825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 91/175] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:28.452542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.469090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.469837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.470119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.470390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] PATH_INFO: `/v3/users/6f6503518a0c42c78fd0dd4792d303ba` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.471663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] RBAC: Authorizing `identity:get_user(user_id=6f6503518a0c42c78fd0dd4792d303ba)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:28.473217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:28.480689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 85/176] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/users/6f6503518a0c42c78fd0dd4792d303ba => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:28.481704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.581765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a618-3563-4bf1-ad7d-dc28200e2a1a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.587694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.655532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.655532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.655532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.655532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.656817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:28.661479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:28.665391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 92/177] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:28.666218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.681016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed70a-c229-4dfd-8aa8-643cadf1b7fb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.731293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.732360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.735357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.736021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.737263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:28.737788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:28.739411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:28.751604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 86/178] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:28.752725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:28.790903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.874546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2115-61a3-4106-8b0b-c53dd1c5d7ad None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.943482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229805a2-4911-48e8-bfcd-e77ea7b84e2e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:28.946799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.947430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.947709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.948016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:28.966834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:28.995440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:28.996458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:28.996942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:28.997401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/62b93961f8f34b7ba29ca3f1e2a57fea/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:29.001000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, user_id=62b93961f8f34b7ba29ca3f1e2a57fea, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.003330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.025937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 87/179] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:28 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/62b93961f8f34b7ba29ca3f1e2a57fea/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:29.027479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:29.101630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.103174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.229342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:29.266100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7756e-0c23-4f1c-83cc-83c6e1cbe06b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:29.321610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 93/180] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:29.325008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:29.337606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:29.337606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:29.337950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:29.337950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] PATH_INFO: `/v3/users/6f6503518a0c42c78fd0dd4792d303ba` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:29.339331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] RBAC: Authorizing `identity:get_user(user_id=6f6503518a0c42c78fd0dd4792d303ba)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.342975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.346285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 88/181] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:29 2022] GET /identity/v3/users/6f6503518a0c42c78fd0dd4792d303ba => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:29.351413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:29.439769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:29.532270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688423e-104b-4022-8829-4dde443fb4a5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:29.574049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0bd5-971b-4689-9a49-3a2993a915fb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:29.609821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:29.610468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:29.610742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:29.611010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:29.612356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.613836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.615734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 94/182] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:29 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:29.628384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:29.661635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:29.662657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:29.663132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:29.663593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:29.674972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:29.808027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f330e-7ddd-4681-a970-7e54644c49e0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:29.822506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.824401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.881229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:29.881883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:29.883979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:29.884270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:29.885015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=cdab158efd9c47d7955ff324d34fadcb, user.id=6f6503518a0c42c78fd0dd4792d303ba) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:29.885352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:29.887316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:29.909151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 95/183] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:29 2022] GET /identity/v3/role_assignments?user.id=6f6503518a0c42c78fd0dd4792d303ba&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:29.913727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:29.992641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 89/184] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:29.999045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:30.196078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:30.208362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1295-49f3-473f-a1ef-005be36f10c2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:30.254076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:30.254999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.254999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.255252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.261709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:30.261709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6776-c3d9-4afe-94bd-efa72acb21ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:30.261709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 96/185] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:29 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:30.269060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:30.430145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe10b-73e2-4844-aad2-4a55302e37f1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:30.483267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:30.483915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.484189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.484456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.486691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] RBAC: Adding query filter params (role.id=291c5a802e814346bb3421d0737828c8, scope.project.id=cdab158efd9c47d7955ff324d34fadcb, user.id=6f6503518a0c42c78fd0dd4792d303ba) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:30.487013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:30.489666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a98cd-3058-441d-a800-f5bae9490aac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:30.497221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 90/186] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:30 2022] GET /identity/v3/role_assignments?user.id=6f6503518a0c42c78fd0dd4792d303ba&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=291c5a802e814346bb3421d0737828c8 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:30.623431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a95ca-30cd-4f9e-b669-d8b13220e58c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.623431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a95ca-30cd-4f9e-b669-d8b13220e58c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.623431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a95ca-30cd-4f9e-b669-d8b13220e58c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.626133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 97/187] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:30.637887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.637887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.637887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.650042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:30.659564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:30.661213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:30.760200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdad2-0097-419d-94d7-6f55ff374727 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.760812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdad2-0097-419d-94d7-6f55ff374727 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.761615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdad2-0097-419d-94d7-6f55ff374727 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.763240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 98/188] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:30.767519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 91/189] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:30.769434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:30.770029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:30.770516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:30.795485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:30.795989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:30.870980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 99/190] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:31.057090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.149538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.164100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3050e6-7bce-4ba0-a911-4c18fa814441 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.204111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.204627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.204904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.205175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.209203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:31.224319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:31.230849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:31.231731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:31.232529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 92/191] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:31.238262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.275692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:31.294621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ae8e-c8ee-4209-a04b-27896a1b84c3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.337898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.338507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.338794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.339357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.340464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:31.342087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:31.346011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 100/192] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:31.349237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.369486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e268ad-e468-4d2b-bae4-80d23cfd4fee None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.408018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.408648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.409149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.409253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.409946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:31.410249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:31.411735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:31.423364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 93/193] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:31.431895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.487830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b8a7-82f1-4e69-9113-e9adc76d34c0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.518638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:31.530286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.532072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.532780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.533050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.533749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:31.535518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:31.564815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 101/194] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:31 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:30:31.588401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8544-eb24-4ce8-b465-8c8dc66dd163 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.642689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.643345 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.643623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.644063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] PATH_INFO: `/v3/users/040f8255109b4443998f523819e47416` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.665868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=040f8255109b4443998f523819e47416)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:31.665868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e32ad-88be-40d5-b549-1141e9f0a9b9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:31.665868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 94/195] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:31 2022] GET /identity/v3/users/040f8255109b4443998f523819e47416 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:31.672826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:31.694852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:31.732952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90a390-4438-4ffa-a3e7-29fa93975a8a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.733817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90a390-4438-4ffa-a3e7-29fa93975a8a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.734367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90a390-4438-4ffa-a3e7-29fa93975a8a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.736383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 95/196] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:31.743817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.744330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.744649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.770401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:31.771609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:31.816844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1890f6-2e17-4318-bfbb-043c3028813f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:31.865076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:31.866248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:31.866806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:31.867073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:31.868950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:31.870543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:31.875697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 102/197] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:31 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:31.881617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 96/198] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:31.881772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:32.007047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:32.049730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0b2d-6a6b-44ab-9f70-92103b28e016 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:32.093363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:32.094100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:32.096169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:32.096169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/040f8255109b4443998f523819e47416/roles/a43d782ae6e24f1daed904ae6059cd34` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:32.098203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, user_id=040f8255109b4443998f523819e47416, role_id=a43d782ae6e24f1daed904ae6059cd34)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:32.099680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:32.122528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 103/199] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:30:31 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/users/040f8255109b4443998f523819e47416/roles/a43d782ae6e24f1daed904ae6059cd34 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:30:32.189035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:32.247947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:32.328214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27181-d871-4ac0-aad7-736795dd85bc None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:32.375973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:32.376723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:32.376996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:32.377319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:32.389626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:32.395897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:32.396739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:32.397508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:32.402362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:32.402811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 97/200] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:32.537215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7db1-eba8-4784-853b-258c03c25c60 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:32.577995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:32.578615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:32.578891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:32.579159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:32.579828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:32.580156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:32.581558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:32.594380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 104/201] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:32.600221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:32.741755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c664-bdac-4f85-90c9-5c6e9fba2bf0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:32.757622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:32.794950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:32.794950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:32.794950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:32.794950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] PATH_INFO: `/v3/users/62b93961f8f34b7ba29ca3f1e2a57fea` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:32.796292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] RBAC: Authorizing `identity:get_user(user_id=62b93961f8f34b7ba29ca3f1e2a57fea)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:32.798105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:32.799975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 98/202] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:32 2022] GET /identity/v3/users/62b93961f8f34b7ba29ca3f1e2a57fea => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:32.806589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:32.809510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:32.949733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931386b-6a15-45cd-961f-6d01699b4302 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:33.014440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:33.015016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:33.015294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:33.015560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:33.103697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:33.105322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:33.110375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:33.212300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 105/203] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:33.218668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:33.340367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f4ff-7fe3-443d-92ea-be1b39d9cd8b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:33.377134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:33.378069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:33.378511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:33.378945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:33.380259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:33.381944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd07d52-10ae-4c06-8cdc-e9c01b2f03d0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:33.384056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 99/204] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:33 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:33.390943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:33.499299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152d9bc-d1a1-43f2-82c0-9dbf1da59766 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:33.505882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:33.539814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:33.540577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:33.540921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:33.541258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:33.543051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] RBAC: Adding query filter params (role.id=0cf9dc9265e6464b9f4900be70acd315, scope.project.id=cdab158efd9c47d7955ff324d34fadcb, user.id=62b93961f8f34b7ba29ca3f1e2a57fea) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:33.543447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:33.545191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab9a7-2d49-4f82-a6db-8645552f56f2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:33.552100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 106/205] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:33 2022] GET /identity/v3/role_assignments?user.id=62b93961f8f34b7ba29ca3f1e2a57fea&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:34.137629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a02a-f4da-472d-9f8d-7004d843dbf1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.137629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a02a-f4da-472d-9f8d-7004d843dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.137629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59a02a-f4da-472d-9f8d-7004d843dbf1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.139410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 100/206] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:34.145311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.145896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.146397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.165935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:34.167642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:34.194095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3528-212e-4e51-9c25-c38ab38b8948 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.195972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3528-212e-4e51-9c25-c38ab38b8948 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.195972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3528-212e-4e51-9c25-c38ab38b8948 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.195972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 101/207] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:30:34.202168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.202793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.203255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.224140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:34.225405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:34.253009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 107/208] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:34.274294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:34.307856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 102/209] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:34.533221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:34.594159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:34.643100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:34.651186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf366c-6e17-473c-ada3-a5f6ae40a2f2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:34.693028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:34.694056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.694383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.694638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.705938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0fde0e7a-b912-443a-8dd1-a828f4cb244e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:34.710825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:34.711905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 108/210] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:34.718437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96905-8de8-4343-9888-86debb424171 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.719136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96905-8de8-4343-9888-86debb424171 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.719136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96905-8de8-4343-9888-86debb424171 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.719136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 109/211] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:34.719953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877233d-2355-46ad-b43c-5d13f48cb367 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:34.720294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96905-8de8-4343-9888-86debb424171 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:34.760537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:34.761075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.761352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.761649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.762774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:34.764330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824687-fdc9-4407-a0f8-604ebc29e512 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:34.766175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 103/212] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:34.767145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.767427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.767700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.788668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:34.789868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:34.826136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:34.841381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96905-8de8-4343-9888-86debb424171 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:34.861245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 104/213] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:34.869845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:34.884872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:34.886516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:34.886787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:34.887103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:34.887763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:34.888604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:34.891187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:34.907119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 110/214] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:34.909408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:34.936467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:34.995427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef3f0-6494-48fa-9d14-60aa7a13a326 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.039884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258856-22bc-44b5-ab0d-33da9b97137e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.046198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.046826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.047098 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.047370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.050581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:35.050581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:35.078941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 105/215] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:34 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:35.082815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.083465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.083741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.084009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] PATH_INFO: `/v3/users/e60d2bbb7f24406a819d874a23ef9a54` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.102342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] RBAC: Authorizing `identity:get_user(user_id=e60d2bbb7f24406a819d874a23ef9a54)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:35.104992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:35.111854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 111/216] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:34 2022] GET /identity/v3/users/e60d2bbb7f24406a819d874a23ef9a54 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:35.113428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:35.134940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:35.151178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:35.245991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:35.259460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0072679-0662-440e-a63b-4f1f03973893 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.273773 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e63-593f-49a8-a223-0e52e3fb90cc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.312340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.313288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.313798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.314070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.316883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] RBAC: Adding query filter params (role.id=0cf9dc9265e6464b9f4900be70acd315, user.id=e60d2bbb7f24406a819d874a23ef9a54, scope.system=all) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:35.317201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:35.318834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:35.326553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.328908 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 106/217] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Oct 17 17:30:35 2022] GET /identity/v3/role_assignments?user.id=e60d2bbb7f24406a819d874a23ef9a54&scope.system=all&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:35.329045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.329045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.329045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.349625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:35.353161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:35.354226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:35.355083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 112/218] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:30:35.361110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:35.490691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:35.507676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dd9c5-97c8-4f40-8e3c-d1b2f8771ab6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.558790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.558987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.559218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.559494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.560183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:35.560499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:35.561926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:35.578456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 107/219] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:35.585527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:35.709808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652ac4-451c-4222-b322-665e4d0a86b1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.756077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.756968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.757422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.757923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] PATH_INFO: `/v3/users/040f8255109b4443998f523819e47416` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.759435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] RBAC: Authorizing `identity:get_user(user_id=040f8255109b4443998f523819e47416)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:35.762065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:35.764165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 113/220] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:35 2022] GET /identity/v3/users/040f8255109b4443998f523819e47416 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:35.770104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:35.905428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367fb99-a94f-4bd1-9d92-0a936a6f2aa3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:35.949136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:35.951011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:35.951011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:35.951011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:35.974014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:36.024432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:36.025897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:36.139023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 108/221] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:36.146004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:36.159454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:36.276992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29faa-83bb-4310-bc32-ff875cfc379a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:36.315096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:36.316114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:36.316622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:36.317096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:36.318462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:36.320127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62d9ac-ec14-47ab-9548-fb0578173ede None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:36.322017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 114/222] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:36 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:36.329148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:36.427035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:36.492288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba714-56b6-41cf-ae78-0a59ba75c639 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:36.531468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:36.532398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:36.532888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:36.533354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:36.534381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] RBAC: Adding query filter params (role.id=a43d782ae6e24f1daed904ae6059cd34, scope.project.id=cdab158efd9c47d7955ff324d34fadcb, user.id=040f8255109b4443998f523819e47416) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:36.534887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:36.536510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5a598-a886-41e7-9d4f-b3052f72da0e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:36.543371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 109/223] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:30:36 2022] GET /identity/v3/role_assignments?user.id=040f8255109b4443998f523819e47416&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=a43d782ae6e24f1daed904ae6059cd34 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:37.606077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95eb0-78a1-459b-95fc-bc55dff5f377 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.606592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95eb0-78a1-459b-95fc-bc55dff5f377 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.606666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95eb0-78a1-459b-95fc-bc55dff5f377 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.608284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 115/224] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:37.615502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b8ca-bf04-46a2-a947-f718f24b4387 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.615502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b8ca-bf04-46a2-a947-f718f24b4387 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.615502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9b8ca-bf04-46a2-a947-f718f24b4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.636652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9dd9b8ca-bf04-46a2-a947-f718f24b4387 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:37.638288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9dd9b8ca-bf04-46a2-a947-f718f24b4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:37.722632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 110/225] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:37.725300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce781a-b4db-47cb-ba60-0a3c29292a93 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.725300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce781a-b4db-47cb-ba60-0a3c29292a93 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.725300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce781a-b4db-47cb-ba60-0a3c29292a93 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.727263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 116/226] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:37.733459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.733821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.734053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.754346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:37.755528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:37.789952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394f5f-0769-4e53-9f7f-57b7db3a126b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.790132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394f5f-0769-4e53-9f7f-57b7db3a126b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.790392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394f5f-0769-4e53-9f7f-57b7db3a126b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.794244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 117/227] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:37.797079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:37.797360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:37.797650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:37.802061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:37.818600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:37.819985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:37.829081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 111/228] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:37.904774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 118/229] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:37.997680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.109334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835c8e-d441-4cb2-834e-57d8d0b7db0c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.112386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.115039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.166630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.167361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.167620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.167892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.185753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:38.190741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:38.191565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:38.192333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:38.196861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 112/230] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:38.197743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.236415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8456-dc2d-4a3a-9131-1d8054ef4cce None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.237407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.275606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.276213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.276489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.276754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.277977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.279512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.281110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 119/231] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:38.281890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.314980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09159-971f-414f-9e28-d01c33a3a2ba None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.356988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.357666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.357945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.358217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.362484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.371337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:38.377540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:38.378417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:38.379212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 113/232] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:38.379842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.402439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023de22-2a09-4d81-9eb1-3bde9d89e5ab None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.438227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.438864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.439113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.439403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.440044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:38.440346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.441765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.451218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 120/233] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:38.456786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.493347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.505775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8321-aa87-40a5-977b-592f60daa459 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.544054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.544893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.545314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.545778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] PATH_INFO: `/v3/groups` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.546424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.548363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.564856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 114/234] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Oct 17 17:30:38 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:38.565710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.574470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d562db-5257-4fd7-9d83-432551486078 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.620843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.628994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.629738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.630114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.630314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.631300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:38.631603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.633613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.646554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 121/235] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:38.652593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.706382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7ae1-f705-4b18-888c-f424ccc135d1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.761960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.762787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.764169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.764169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] PATH_INFO: `/v3/users/afa4019f15c44ffab1679d0f31726688` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.781895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] RBAC: Authorizing `identity:get_user(user_id=afa4019f15c44ffab1679d0f31726688)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.784637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.789627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 115/236] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/users/afa4019f15c44ffab1679d0f31726688 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:38.793567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.795335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befaf7a-adaf-4102-af57-4ca63aafffb9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.811553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.850148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.850790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.851318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.851579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] PATH_INFO: `/v3/users/e60d2bbb7f24406a819d874a23ef9a54` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.853480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] RBAC: Authorizing `identity:get_user(user_id=e60d2bbb7f24406a819d874a23ef9a54)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.855451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.861629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 122/237] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/users/e60d2bbb7f24406a819d874a23ef9a54 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:38.864733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:38.930573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848daf4-bd60-4a19-a84d-9096bf222742 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:38.961361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:38.978228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:38.978850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:38.979225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:38.979536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:38.980280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] RBAC: Adding query filter params (role.id=a43d782ae6e24f1daed904ae6059cd34, user.id=afa4019f15c44ffab1679d0f31726688, scope.system=all) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:38.980593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:38.982071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df212-e4d1-4d0f-bd3b-aff2a238c6de None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:38.989634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 116/238] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Oct 17 17:30:38 2022] GET /identity/v3/role_assignments?user.id=afa4019f15c44ffab1679d0f31726688&scope.system=all&role.id=a43d782ae6e24f1daed904ae6059cd34 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:39.021002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ce53-2b79-4689-8c71-5346d1fa24d3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:39.063374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:39.064437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:39.064941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:39.065405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] PATH_INFO: `/v3/system/users/e60d2bbb7f24406a819d874a23ef9a54/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:39.067175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e60d2bbb7f24406a819d874a23ef9a54, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:39.068838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3125c-98a5-4f7b-b3fb-989896b03d0e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:39.084431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 123/239] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Oct 17 17:30:38 2022] PUT /identity/v3/system/users/e60d2bbb7f24406a819d874a23ef9a54/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:40.799670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fe5-9aaa-4bb2-b0f3-92b62a401ef8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:40.799670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fe5-9aaa-4bb2-b0f3-92b62a401ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:40.799670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fe5-9aaa-4bb2-b0f3-92b62a401ef8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:40.799670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 117/240] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:40.804979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cf68-86cb-404c-a5f5-02d4183609f5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:40.805380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cf68-86cb-404c-a5f5-02d4183609f5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:40.805570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03cf68-86cb-404c-a5f5-02d4183609f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:40.828184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6b03cf68-86cb-404c-a5f5-02d4183609f5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:40.829828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b03cf68-86cb-404c-a5f5-02d4183609f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:40.901211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 124/241] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:41.169192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885fe5-9aaa-4bb2-b0f3-92b62a401ef8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.261458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:41.271767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e423c6-69f1-429f-8eb9-b5e7f9b9b3be None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.272052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e423c6-69f1-429f-8eb9-b5e7f9b9b3be None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.272330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e423c6-69f1-429f-8eb9-b5e7f9b9b3be None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.273709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 125/242] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:41.279409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020287-43a4-431a-94dc-281915cea3c9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.279752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020287-43a4-431a-94dc-281915cea3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.279954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020287-43a4-431a-94dc-281915cea3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.287609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885fe5-9aaa-4bb2-b0f3-92b62a401ef8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:41.298821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2c020287-43a4-431a-94dc-281915cea3c9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:41.300008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c020287-43a4-431a-94dc-281915cea3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:41.324824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:41.325466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.325775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.326046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.327159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:41.328595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6646-0640-49a1-80c7-29071c19fb88 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:41.333643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 118/243] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:41.333643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8f6e-000d-4ac9-9adf-099ec53961de None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.333643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8f6e-000d-4ac9-9adf-099ec53961de None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.333643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d8f6e-000d-4ac9-9adf-099ec53961de None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.333643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 119/244] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:41.336035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d8f6e-000d-4ac9-9adf-099ec53961de None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.355563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:41.373633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 126/245] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:41.375273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.375554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.375820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.393608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:41.394973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:41.454806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d8f6e-000d-4ac9-9adf-099ec53961de None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:41.474237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 127/246] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:41.491399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:41.492010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.492280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.492547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] PATH_INFO: `/v3/groups` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.493167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:41.495063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:41.511137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 120/247] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Oct 17 17:30:41 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:30:41.650937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.746757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.758181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:41.772803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f781288-be44-46d5-bd22-57fd3e1bfe9c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:41.802450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:41.820999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:41.821694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.821987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.822581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.839249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:41.844109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:41.844977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:41.845838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:41.849658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 128/248] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:41.851572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.877656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c641-e253-4d79-8ac9-ff2f723309e8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:41.925746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:41.926629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:41.927052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:41.927490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:41.942425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:41.951128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:41.952053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:41.952822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 121/249] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:41.963764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:41.981089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0d09-cc95-4367-b90b-67f42bb45f0b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.026641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.027288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.027638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.027976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.028718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:42.029088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.030651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.052138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 129/250] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:42.059831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:42.060708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:42.114174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ead2c-1205-4bd5-afb5-bb40459663e6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.120017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:42.174889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.175920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.176368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.176789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.177821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:42.178675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.180473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.192468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 122/251] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:42.198796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:42.203036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fcf9-cc82-4f75-8817-1f3cfcc817c2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.254442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.255491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.256534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.257025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] PATH_INFO: `/v3/users/afa4019f15c44ffab1679d0f31726688` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.258880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] RBAC: Authorizing `identity:get_user(user_id=afa4019f15c44ffab1679d0f31726688)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.261042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.263548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 130/252] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:42 2022] GET /identity/v3/users/afa4019f15c44ffab1679d0f31726688 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:42.269970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:42.356346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef35f3-fe01-439b-849c-f62e17119e86 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.414965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.414965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.415224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.415479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] PATH_INFO: `/v3/users/e60d2bbb7f24406a819d874a23ef9a54` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.417957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:42.419069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] RBAC: Authorizing `identity:get_user(user_id=e60d2bbb7f24406a819d874a23ef9a54)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.421116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.422880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 123/253] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:42 2022] GET /identity/v3/users/e60d2bbb7f24406a819d874a23ef9a54 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:42.428991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:42.431414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13698c-ae66-4b42-85ff-9a415377c176 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.450121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:42.517375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.518098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.518378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.518658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] PATH_INFO: `/v3/system/users/afa4019f15c44ffab1679d0f31726688/roles/a43d782ae6e24f1daed904ae6059cd34` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.521311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afa4019f15c44ffab1679d0f31726688, role_id=a43d782ae6e24f1daed904ae6059cd34)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.524658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b990e-61ad-4e7e-b0cd-4e225e5e9e8c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.544239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 131/254] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Oct 17 17:30:42 2022] PUT /identity/v3/system/users/afa4019f15c44ffab1679d0f31726688/roles/a43d782ae6e24f1daed904ae6059cd34 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:30:42.605138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b8e0-6384-4d0c-ba4b-4a7b58869b3c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:42.649748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:42.650394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:42.650704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:42.651260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:42.652521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] RBAC: Adding query filter params (role.id=0cf9dc9265e6464b9f4900be70acd315, user.id=e60d2bbb7f24406a819d874a23ef9a54, scope.system=all) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:42.652841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:42.654487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890063-ce73-466e-b44c-474738d2e5ce None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:42.672391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 124/255] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Oct 17 17:30:42 2022] GET /identity/v3/role_assignments?user.id=e60d2bbb7f24406a819d874a23ef9a54&scope.system=all&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:43.927280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe93-c60b-4cf8-8769-c01b569b8564 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:43.928284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe93-c60b-4cf8-8769-c01b569b8564 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:43.928847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1fe93-c60b-4cf8-8769-c01b569b8564 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:43.930583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 132/256] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:43.936091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7089b-ba75-4c47-8d71-b6295f1d1393 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:43.936636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7089b-ba75-4c47-8d71-b6295f1d1393 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:43.936636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7089b-ba75-4c47-8d71-b6295f1d1393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:43.958134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d5c7089b-ba75-4c47-8d71-b6295f1d1393 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:43.959342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5c7089b-ba75-4c47-8d71-b6295f1d1393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:44.034136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:44.046130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 125/257] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 17:30:44.395099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b6e-f279-423d-8dd1-97f812200c63 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.395498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b6e-f279-423d-8dd1-97f812200c63 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.395668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301b6e-f279-423d-8dd1-97f812200c63 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.397170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 133/258] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:44.402714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.402998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.403274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.430579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:44.431837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:44.444418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 126/259] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 17:30:44.537499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301b6e-f279-423d-8dd1-97f812200c63 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:44.551311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301b6e-f279-423d-8dd1-97f812200c63 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:44.558796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:44.559443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.559724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.560000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.573754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:44.578634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:44.579476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:44.580256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 134/260] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:30:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:44.586954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:44.597319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424929b3-54e9-45d9-909a-4fc2c9be267d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:44.606808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:44.607751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.608200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.608637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.609485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:44.609982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:44.612012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:44.612012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:30:44.612012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:30:44.613248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:44.627319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 127/261] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:30:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:44.633726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:44.649145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51773f-f239-44ff-982f-922b309a178b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:44.657769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:44.658418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.658701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.659001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.670701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:44.672488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:44.672488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:30:44.672488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:30:44.673752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:44.675436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 135/262] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Oct 17 17:30:44 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:44.681071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:44.697665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412b13-1745-426d-856f-5cf66fc84579 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:44.705427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:44.706342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.706762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.707226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.708502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:44.711012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed546a-3eea-46cb-a3ce-229a1f56abd8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:44.712852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 128/263] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:30:44 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:44.719163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:44.735813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c1c0-0808-49e1-883c-9fa900f40399 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:44.743187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:44.744001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.744292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.744649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/groups/99b04de5cb694c2b9651e704441b0f10/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.747289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, group_id=99b04de5cb694c2b9651e704441b0f10, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:44.748403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:44.748403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:30:44.748403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:30:44.750927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38022-e947-4f5a-b62d-496349c29410 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:44.772126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 136/264] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Oct 17 17:30:44 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/groups/99b04de5cb694c2b9651e704441b0f10/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:44.867223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c610-1e9b-4731-bdc0-407192a977e1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.867844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c610-1e9b-4731-bdc0-407192a977e1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.868291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c610-1e9b-4731-bdc0-407192a977e1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.870061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 129/265] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:44.888004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:44.888293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:44.888577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:44.913280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:44.914493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:44.985422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 137/266] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 17:30:45.071194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c610-1e9b-4731-bdc0-407192a977e1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.086292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c610-1e9b-4731-bdc0-407192a977e1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.091276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.092018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.092342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.092569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.107500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:45.112930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:45.113836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:45.114614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 130/267] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:45.120375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.134966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30625e5-e409-4def-972d-68540445a0c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.140175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.140810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.141140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.141418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.142126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:45.142433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.143454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:45.143454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:30:45.143454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:30:45.144498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.156011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 138/268] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.161668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.173142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec126b-6066-48ec-a943-2ca5f4c76515 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.182352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.183316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.183599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.183937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.185241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.187174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:45.187174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:30:45.187174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:30:45.187698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.189984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 131/269] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.195025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.206857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66155c67-1655-47de-9b98-404d86b66d2d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.212403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.213034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.213644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.214110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.215497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.217749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.219446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 139/270] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.225184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.236276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a2bf-d188-4c03-8106-3bcd6e994cd3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.242417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.243088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.243424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.243706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd/groups/99b04de5cb694c2b9651e704441b0f10/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.246515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619912d46701490f8e45f6d01c2ee0bd, group_id=99b04de5cb694c2b9651e704441b0f10, role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.247591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:30:45.247591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:30:45.247591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:30:45.249721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.267829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 132/271] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Oct 17 17:30:45 2022] PUT /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd/groups/99b04de5cb694c2b9651e704441b0f10/roles/291c5a802e814346bb3421d0737828c8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:45.527624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.538513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee141-e71c-4e81-990d-07656ea4a831 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.600729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.601776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.602234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.602681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.615956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:45.621718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:45.622591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:45.623370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:45.626024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 140/272] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:45.631560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.642816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7faf21-bdcd-45ff-8e2f-9dc4a8e1bf95 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.652929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.653930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.654363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.654776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.655598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:45.656042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.657830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.667862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 133/273] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.674393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.686019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479246-b09a-43ee-a3cd-cf84a3dce983 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.691909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.692830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.693296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.693761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.695059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.697253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.699613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 141/274] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.705477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.716705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecca2-fb8b-4f73-b9c4-4eeb37bd0e58 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.725423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.726181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.726463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.726734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.727981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.730519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86094e4-ad72-4e6c-8d95-25c83f1ec980 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.732604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 134/275] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:30:45 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:45.738461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:45.750358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc6041-06f2-43ad-aa50-3a686c3df53b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:45.755124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:45.755787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:45.756112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:45.756389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/groups/99b04de5cb694c2b9651e704441b0f10/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:45.758453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, group_id=99b04de5cb694c2b9651e704441b0f10, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:45.761321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76007f38-d9ea-459d-9398-6a286ff1ce19 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:45.765908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:45.785188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 142/276] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Oct 17 17:30:45 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/groups/99b04de5cb694c2b9651e704441b0f10/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:46.177292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6fd2-93d9-4d0a-b4bf-fb65ea5b7599 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.178035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6fd2-93d9-4d0a-b4bf-fb65ea5b7599 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.178035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6fd2-93d9-4d0a-b4bf-fb65ea5b7599 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.179408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 135/277] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:46.186215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65687535-e857-45da-ac78-8b8c0f998e5d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.186811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65687535-e857-45da-ac78-8b8c0f998e5d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.186811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65687535-e857-45da-ac78-8b8c0f998e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.208764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-65687535-e857-45da-ac78-8b8c0f998e5d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:46.210009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65687535-e857-45da-ac78-8b8c0f998e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:46.305616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 143/278] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:46.499433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ace00-a7c0-46e3-a952-aa96439c0204 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.499761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ace00-a7c0-46e3-a952-aa96439c0204 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.500299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ace00-a7c0-46e3-a952-aa96439c0204 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.501685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 136/279] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:46.507094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb3ec-52f1-4101-9e1e-a7c75125d875 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.507379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb3ec-52f1-4101-9e1e-a7c75125d875 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.507658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb3ec-52f1-4101-9e1e-a7c75125d875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.535271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d58bb3ec-52f1-4101-9e1e-a7c75125d875 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:46.536471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d58bb3ec-52f1-4101-9e1e-a7c75125d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:46.616446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 144/280] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 17:30:46.916547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ace00-a7c0-46e3-a952-aa96439c0204 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:46.926721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1093a5-67b0-42dc-a978-5428e7fd7478 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.927018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1093a5-67b0-42dc-a978-5428e7fd7478 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.927258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1093a5-67b0-42dc-a978-5428e7fd7478 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.928646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 145/281] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:46.934492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:46.935443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:46.935925 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:46.970807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:46.973269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:46.985418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 146/282] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 17:30:47.067225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ace00-a7c0-46e3-a952-aa96439c0204 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.113835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.114845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.115354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.115822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.126081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.131702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:47.137097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:47.142102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:47.143013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:47.144385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 137/283] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:47.148678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee616-de6a-4634-a6c1-feade75d5fa7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.149020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.159293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.160011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.160296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.160622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.189686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:47.190392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:47.191294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:47.192067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:47.198145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 147/284] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:47.204937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.222942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177970c0-1966-4187-8063-d5a088137215 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.236430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.237103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.237379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.237742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.238419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:47.238736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.240448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.256632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 148/285] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.263083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.280262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e43b5-42ec-4ff8-bccf-0ce14c7f0b04 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.287562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.288269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.288537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.288806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.290949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.293203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.295242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 149/286] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.300900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.314550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953f787-3fc2-4e97-b829-89c5053405eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.319793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a3ea-3816-4486-bcc1-186e1ec9c2e6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.321492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.322164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.322445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.322831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.325278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.326617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.329265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 150/287] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.334527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.350769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e69424-0037-408f-bf9d-ef452c6974cc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.358607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.359366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.359652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.359919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb/groups/99b04de5cb694c2b9651e704441b0f10/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.363434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdab158efd9c47d7955ff324d34fadcb, group_id=99b04de5cb694c2b9651e704441b0f10, role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.366211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.382016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.382983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.383556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.384093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.385093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:47.386258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.388709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.395877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 151/288] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Oct 17 17:30:47 2022] PUT /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb/groups/99b04de5cb694c2b9651e704441b0f10/roles/291c5a802e814346bb3421d0737828c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:47.396724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.404286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 138/289] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.409835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.446548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:47.531324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:47.534972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b09ad-a690-4af4-b836-7a0739c855b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.551845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.552535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.552815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.553140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.579326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:47.584380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:47.585298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:47.586170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:47.589993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 152/290] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:47.596454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.613025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e121-ff1a-44cc-ae65-f47200326726 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.614064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225088e-6ac5-4fe4-89c0-37679d436c27 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.632408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.633081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.633363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.633660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.634402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:47.634715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.636481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.655333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 153/291] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.670333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.670654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.670983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.671358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.671636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] PATH_INFO: `/v3/users/afa4019f15c44ffab1679d0f31726688` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.672779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=afa4019f15c44ffab1679d0f31726688)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.674270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.676048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 139/292] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/users/afa4019f15c44ffab1679d0f31726688 => generated 293 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:47.683352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.688133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379ba0-d6c4-4156-a7ab-d8b76f8ee662 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.706867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.707484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.707761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.708025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] PATH_INFO: `/v3/groups/76d6ff5ceeef4110a84029f0648c4a85` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.726245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] RBAC: Authorizing `identity:get_group(group_id=76d6ff5ceeef4110a84029f0648c4a85)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.728207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.730407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 154/293] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/groups/76d6ff5ceeef4110a84029f0648c4a85 => generated 229 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:47.755321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.777387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69652d2-5b1a-4930-a191-99e0ff135dc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.798284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.798944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.799220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.799496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] PATH_INFO: `/v3/projects/a760cc568b8d4fdf85c6c5d207733585` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.799865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec30e-36a5-4c66-b4d3-25333ff53ae6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.806391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] RBAC: Authorizing `identity:get_project(project_id=a760cc568b8d4fdf85c6c5d207733585)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.808564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.810670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 155/294] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/projects/a760cc568b8d4fdf85c6c5d207733585 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:47.822670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:47.837003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:47.839285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487f0b9-0055-458c-9cc0-bbb0b271ba92 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:47.848758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.849389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.849703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.850075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.850871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] RBAC: Adding query filter params (role.id=a43d782ae6e24f1daed904ae6059cd34, user.id=afa4019f15c44ffab1679d0f31726688, scope.system=all) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:47.851186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.852741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8857a-172a-4418-ae7b-baced2e72cd1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.854431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:47.855129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:47.855397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:47.855673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] PATH_INFO: `/v3/projects/a760cc568b8d4fdf85c6c5d207733585/groups/76d6ff5ceeef4110a84029f0648c4a85/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:47.857757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a760cc568b8d4fdf85c6c5d207733585, group_id=76d6ff5ceeef4110a84029f0648c4a85, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:47.860419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece92b8c-f764-4228-abdf-f21638b11c05 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:47.875949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 140/295] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Oct 17 17:30:47 2022] GET /identity/v3/role_assignments?user.id=afa4019f15c44ffab1679d0f31726688&scope.system=all&role.id=a43d782ae6e24f1daed904ae6059cd34 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:47.888279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 156/296] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Oct 17 17:30:47 2022] PUT /identity/v3/projects/a760cc568b8d4fdf85c6c5d207733585/groups/76d6ff5ceeef4110a84029f0648c4a85/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:30:48.718999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f0e2-0b00-42a0-8a4a-c68695c29ca7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:48.719676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f0e2-0b00-42a0-8a4a-c68695c29ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:48.719676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f0e2-0b00-42a0-8a4a-c68695c29ca7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:48.721094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 141/297] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:48.726515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b728-9564-4d08-94de-be8d78ec3e51 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:48.727131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b728-9564-4d08-94de-be8d78ec3e51 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:48.727131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023b728-9564-4d08-94de-be8d78ec3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:48.746413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3023b728-9564-4d08-94de-be8d78ec3e51 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:48.747595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3023b728-9564-4d08-94de-be8d78ec3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:48.822238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 157/298] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:48.853011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9128c4-ee51-4a42-8296-c31eec00ee88 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:48.853335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9128c4-ee51-4a42-8296-c31eec00ee88 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:48.853558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9128c4-ee51-4a42-8296-c31eec00ee88 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:48.854997 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 142/299] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:48.860478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:48.860830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:48.861111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:48.884468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:48.885783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:48.953114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:48.969182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 158/300] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:49.188737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9128c4-ee51-4a42-8296-c31eec00ee88 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:49.326829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9128c4-ee51-4a42-8296-c31eec00ee88 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:49.367066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:49.367707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.367980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.368252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.379788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-df5a76e4-7059-4058-bc0a-ede9a43e6217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:49.385196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:49.386106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:49.386906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 143/301] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:49.394563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:49.434798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330fb6-3091-487c-b07f-d39aa8e1b0c3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.435116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330fb6-3091-487c-b07f-d39aa8e1b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.435346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330fb6-3091-487c-b07f-d39aa8e1b0c3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.438073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 144/302] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:30:49.454123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.454123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.454123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.477564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:49.478836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:49.529942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:49.565927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6384-c3aa-46fd-a306-2537dabab6fd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:49.568000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 145/303] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:49.568856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:49.614231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:49.614849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.615123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.615393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.616057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:49.616356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:49.617971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:49.641404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 159/304] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:49.647233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:49.748745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:49.759479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e463fe-5eaf-4af6-ae7f-dce1b869636f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:49.828239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:49.828884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.829154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.829421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.844376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb760-c2fe-4de0-bf81-fe01f75cd286 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:49.856568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:49.865386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:49.866295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:49.867090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:49.868155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 146/305] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:49.887075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:49.911985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:49.912953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:49.913985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:49.914483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:49.929385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:49.999367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.001156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.025816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441ba1-f04f-4c7f-b037-664de0cf11b1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.063088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.075813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.076799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.077342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.078113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.079430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:50.080172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.081984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.092927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 147/306] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:50.094114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.130584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 160/307] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 17 17:30:50.130584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.227225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.232071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f17bf0-f165-48dd-b5b7-2a1831c59b36 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.253976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753217-0d98-49bd-9a7b-af34bd1c2d27 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.280037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.280480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.280705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.280982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.301408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:50.305264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.305928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.306210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.306483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:50.309392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:50.310306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 17:30:50.311081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:50.313181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 148/308] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:50.314152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.340299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.397990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.400138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ce42c-1396-4dc0-b3c5-9fbc77efc887 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.461322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4a32-15b7-4189-a900-09795033dda2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.513090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.513776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.514053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.514493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.516007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.517629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.519602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 149/309] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:50.520377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.544981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 161/310] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:50.550939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765500e-4073-47f9-8c30-b9b231fd5be9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.550939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765500e-4073-47f9-8c30-b9b231fd5be9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.550939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765500e-4073-47f9-8c30-b9b231fd5be9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.551880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 162/311] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:50.556643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765500e-4073-47f9-8c30-b9b231fd5be9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.559152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.641002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.664088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360296c2-3d88-4b44-996f-5be4522921ac None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.701161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.701955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.702173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765500e-4073-47f9-8c30-b9b231fd5be9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.702369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.702713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.703497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:50.703944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.705438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.715484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 150/312] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:50.716357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.747414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.748256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.748464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.748730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.750888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.752557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc5c2-81f1-4dd9-aa0f-f47a8ae6ed74 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.754329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 163/313] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:50.755671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.755974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.756926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.777370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:50.778928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:50.823283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.841760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda26546-0043-4981-88b5-3c617a2a03b1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:50.855477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 164/314] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:50.856421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.889032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:50.889716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.889995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.890267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] PATH_INFO: `/v3/projects/619912d46701490f8e45f6d01c2ee0bd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.891581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] RBAC: Authorizing `identity:get_project(project_id=619912d46701490f8e45f6d01c2ee0bd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:50.893384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c7f15-7b3d-4fcd-8ee5-1199adc5249a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:50.895211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 151/315] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/projects/619912d46701490f8e45f6d01c2ee0bd => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:50.896343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b856-468e-4265-a317-b64039a657da None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:50.896622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b856-468e-4265-a317-b64039a657da None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:50.896888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b856-468e-4265-a317-b64039a657da None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:50.898271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 152/316] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:50.898869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b856-468e-4265-a317-b64039a657da None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:50.923711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:50.999522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce379ce9-28b9-4845-a73e-572d69b77bbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.030169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b856-468e-4265-a317-b64039a657da None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.048226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.048849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.049130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.049400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.072421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.073230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.073614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.073891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.075334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] RBAC: Adding query filter params (group.id=99b04de5cb694c2b9651e704441b0f10, role.id=0cf9dc9265e6464b9f4900be70acd315, scope.project.id=619912d46701490f8e45f6d01c2ee0bd) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:51.075334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.076357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.082731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 153/317] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/role_assignments?group.id=99b04de5cb694c2b9651e704441b0f10&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.083627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.114790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.151403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.155313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.216298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.222553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d6799-06e6-4f9f-84c9-fe48507f511d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.276033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.276033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.276033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.276033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.277327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.278813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5739710-0c17-4189-9f48-5fba2c190cc1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.280442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 154/318] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.281597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.281881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.282152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.287946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 165/319] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:51.289044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.301510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:51.302743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:51.383348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 155/320] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:51.384581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.405360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.416757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6d7f-27cf-4a80-9ffb-e0eb60217bef None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.463511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.464146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.464571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.464843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.484829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:51.490183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:51.491071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 166/321] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:51.495372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.508948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.531555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516454-3c81-48a7-82ab-631022bf4829 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.579442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.580062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.580701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.580701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.581313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] RBAC: Adding query filter params (group.id=99b04de5cb694c2b9651e704441b0f10, role.id=291c5a802e814346bb3421d0737828c8, scope.project.id=619912d46701490f8e45f6d01c2ee0bd) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:51.582033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.583130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.591244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 156/322] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/role_assignments?group.id=99b04de5cb694c2b9651e704441b0f10&scope.project.id=619912d46701490f8e45f6d01c2ee0bd&role.id=291c5a802e814346bb3421d0737828c8 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.592440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.629162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1236c-4b90-4a72-89a1-b5ec6bf00eb9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.681963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.682621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.683005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.683283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.685263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.686947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.688678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 167/323] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.689556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.703437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.733822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc128-a4f4-4542-a213-bf2b43636f7f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.780892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.782651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.782651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.782651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.783118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:51.783488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.784942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.794818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 157/324] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.795710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.800217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:51.823536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd975-15c1-4326-a436-566a8469a801 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.865791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.866434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.866715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.866982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.879735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:51.885260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:51.886314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:30:51.887153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:51.887794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 168/325] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:51.889867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.915160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbb903-f1f9-434b-9b36-79e492294968 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:51.957605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:51.958258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:51.958538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:51.958814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:51.959932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:51.961367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:51.963059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 158/326] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:51.963851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:51.980312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.014428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f4b31-42e1-4096-b685-fa58f11e80d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.050947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.051720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.051831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.052014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.055892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.075641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6949d24-93eb-48f6-94e4-9a134b99cd8c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.109250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.109887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.110162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.110435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.111094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:52.111389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.112750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.121247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 159/327] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:52.126852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.126953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.127062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.200593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.223417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 169/328] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:52.224293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.226763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb6853-3165-43fc-9f31-e246d0b9a896 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.258022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.261500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.262141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.262426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.262701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.263432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] RBAC: Adding query filter params (group.id=99b04de5cb694c2b9651e704441b0f10, role.id=0cf9dc9265e6464b9f4900be70acd315, scope.project.id=cdab158efd9c47d7955ff324d34fadcb) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:52.263741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.265193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.271367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 160/329] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/role_assignments?group.id=99b04de5cb694c2b9651e704441b0f10&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=0cf9dc9265e6464b9f4900be70acd315 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:52.272170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.339011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a42b9b-4001-4831-8b56-f9ef750b9dee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.379715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.380748 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.381344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.381627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.400648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4a057-3327-4b39-9253-60317aff3d74 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.442231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.442231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.442231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.442231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] PATH_INFO: `/v3/projects/cdab158efd9c47d7955ff324d34fadcb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.443078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=cdab158efd9c47d7955ff324d34fadcb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.444520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.446369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 161/330] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/projects/cdab158efd9c47d7955ff324d34fadcb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:52.452506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.467662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.473253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.476211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.517702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.580981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7830da-fc5b-438d-8796-e909c714f1f6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.597323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 170/331] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:30:52.603310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.620688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.621325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.621944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.621944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] PATH_INFO: `/v3/groups/99b04de5cb694c2b9651e704441b0f10` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.623139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] RBAC: Authorizing `identity:get_group(group_id=99b04de5cb694c2b9651e704441b0f10)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.624499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.631336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 162/332] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/groups/99b04de5cb694c2b9651e704441b0f10 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:52.632547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.708734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.716303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637974fb-78c9-462b-8f4d-e83e57af154a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.734725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41b71-ad01-4c62-9546-627f469f96b8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.749639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.750573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.750851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.751117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] PATH_INFO: `/v3/projects/a760cc568b8d4fdf85c6c5d207733585` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.752478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] RBAC: Authorizing `identity:get_project(project_id=a760cc568b8d4fdf85c6c5d207733585)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.753949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.755573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 171/333] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/projects/a760cc568b8d4fdf85c6c5d207733585 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:52.761394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:52.764998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:52.771737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.772343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.772620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.773239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.774001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] RBAC: Adding query filter params (group.id=99b04de5cb694c2b9651e704441b0f10, role.id=291c5a802e814346bb3421d0737828c8, scope.project.id=cdab158efd9c47d7955ff324d34fadcb) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:52.774314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.775804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.781508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 163/334] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/role_assignments?group.id=99b04de5cb694c2b9651e704441b0f10&scope.project.id=cdab158efd9c47d7955ff324d34fadcb&role.id=291c5a802e814346bb3421d0737828c8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:52.883635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cee450-5021-494a-8fd7-1f2f415650fb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:52.921433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:52.922112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:52.922383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:52.922647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] PATH_INFO: `/v3/groups/76d6ff5ceeef4110a84029f0648c4a85` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:52.923828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] RBAC: Authorizing `identity:get_group(group_id=76d6ff5ceeef4110a84029f0648c4a85)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:52.925278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf5ca-fd89-4b91-b238-b4ca4e513d2d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:52.926909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 172/335] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/groups/76d6ff5ceeef4110a84029f0648c4a85 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:52.933156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:53.036577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e6e54-a53c-4daa-8e3c-a32c7a48ebdc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:53.073108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:53.073818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:53.074104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:53.074374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:53.075111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] RBAC: Adding query filter params (group.id=76d6ff5ceeef4110a84029f0648c4a85, role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=a760cc568b8d4fdf85c6c5d207733585) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:53.075416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:53.076845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca663c-e210-452c-bbdf-1ec21108c60e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:53.083435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 164/336] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Oct 17 17:30:52 2022] GET /identity/v3/role_assignments?group.id=76d6ff5ceeef4110a84029f0648c4a85&scope.project.id=a760cc568b8d4fdf85c6c5d207733585&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:55.821193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decea2-7dd2-4f96-8d4b-c57b7e50455f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:55.822269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decea2-7dd2-4f96-8d4b-c57b7e50455f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:55.822907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decea2-7dd2-4f96-8d4b-c57b7e50455f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:55.824713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 173/337] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:55.830222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b60b-a861-4802-a13f-d89bf2608bb5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:55.831169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b60b-a861-4802-a13f-d89bf2608bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:55.831628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b60b-a861-4802-a13f-d89bf2608bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:55.841468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:55.857951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d1d7b60b-a861-4802-a13f-d89bf2608bb5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:55.859160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d1d7b60b-a861-4802-a13f-d89bf2608bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:55.938925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 165/338] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:56.020355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a016-2e7b-401c-8604-e76fceafcbb5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.020693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a016-2e7b-401c-8604-e76fceafcbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.020901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a016-2e7b-401c-8604-e76fceafcbb5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.022521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 174/339] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:56.030014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400997-bebf-4155-b106-e23d1884c9c4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.030296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400997-bebf-4155-b106-e23d1884c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.030573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400997-bebf-4155-b106-e23d1884c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.058123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-96400997-bebf-4155-b106-e23d1884c9c4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:56.059311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-96400997-bebf-4155-b106-e23d1884c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:56.145572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 166/340] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:30:56.277199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45bb2-2647-40fa-aa9b-59e46e323eaa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.277520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45bb2-2647-40fa-aa9b-59e46e323eaa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.277783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45bb2-2647-40fa-aa9b-59e46e323eaa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.279484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 175/341] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:56.285127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.285414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.285766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.307532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:56.309053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:56.371035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:56.383943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 167/342] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:56.482345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45bb2-2647-40fa-aa9b-59e46e323eaa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:56.492409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:56.602903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc9fa9-96fe-4f3c-ac74-a5646d2295b2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:56.635694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:56.640819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:56.641390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.641697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.641970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.653429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:56.654930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:56.660125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45bb2-2647-40fa-aa9b-59e46e323eaa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4b849555-fd19-4f3c-8528-fe3ede6b9a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:30:56.670466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:56.671469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:30:56.672302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:30:56.672302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:56.672302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:56.672302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 168/343] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:30:56.673457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b57e-c4b0-41dd-9415-a7a2d539cd4b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.676399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b57e-c4b0-41dd-9415-a7a2d539cd4b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.676399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434b57e-c4b0-41dd-9415-a7a2d539cd4b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.676399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 169/344] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:56.677871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434b57e-c4b0-41dd-9415-a7a2d539cd4b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:56.702287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:56.703015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.703351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.703559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.714796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:56.716255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:56.730235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-dfa0f4b7-d4e6-463f-8508-938779a824ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:30:56.732690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:56.733613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:30:56.734479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:30:56.734479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:56.734479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:56.741312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 176/345] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:56.742824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.743292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.743739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.763017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:56.764300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:56.789320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434b57e-c4b0-41dd-9415-a7a2d539cd4b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:56.828689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:56.829623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:56.829899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:56.830376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:56.831011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:56.831343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:56.832718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:56.835854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 177/346] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:56.837160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:56.857182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 170/347] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:30:56.857182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:56.912308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:56.962646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c5f97-12e8-4741-bfb6-f1990262e79a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:56.985076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa8ee-55ae-42cf-9f58-1d28dbeb92ab None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:56.988482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:57.004095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.005175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.005757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.006236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.007171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:57.007663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.009310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.027538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 178/348] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:57.027987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.028638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.028914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.029191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.029892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.043080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.045390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:30:57.065689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:57.066621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:30:57.068166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:30:57.068166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:57.068166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:57.068166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 171/349] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:57.068166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.142581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9390f1-09d1-4b0f-9969-07dee1a837a4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.158001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:57.181962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.182800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.183082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.183271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b2a6-d864-4fac-9f65-2916cb0fd4cb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.183384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.183998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.186456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.213041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 179/350] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:57.213734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.224931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.225722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.225999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.226319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.227050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.228638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.255795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 172/351] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:57.263090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.289988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:57.344904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8b6a-cbfc-4ddc-96c9-b70d7abea361 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.384504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.385701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.386183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.386684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.387589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:57.388122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.389809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0acbbf-aa9e-4d3b-afc8-7e7e7f215c47 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.404592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 180/352] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:57.410493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c158c-68ef-423f-a191-79374c7853e4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.410798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c158c-68ef-423f-a191-79374c7853e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.411049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c158c-68ef-423f-a191-79374c7853e4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.412471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 181/353] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:57.414878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c158c-68ef-423f-a191-79374c7853e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.442365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355da2-5caf-4ddf-bbc6-106e637c0cf3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.465185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:57.492848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.493892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.494482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.494920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.507239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.509408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c55a6c6a-7a6b-478c-8a42-fd3e9f871ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:30:57.526187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:57.527267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:30:57.528103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:30:57.528103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:30:57.528103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:57.529918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 173/354] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:57.531338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.531753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.532215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.554796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:57.557039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:57.568528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c158c-68ef-423f-a191-79374c7853e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.616583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.617937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.618479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.618771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.619694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.622439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.631099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:57.642946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 174/355] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:57.644286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.668227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 182/356] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:57.811357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df669b-51f6-489d-9bd1-1b0636b32628 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:57.860121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:57.860768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:57.860991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:57.861259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:57.861928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:57.862223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:57.863573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:57.876210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 175/357] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:57.881772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.980229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:57.985034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:58.002122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510765-8cdf-4790-a40a-9934e9c0f6e8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:58.040478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:58.041530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:58.042099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:58.042596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:58.043464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:58.045505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:58.060918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:58.076980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 183/358] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:30:58.123870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0e78-be18-42c8-adc6-db2729b78965 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:58.165600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:58.166262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:58.166533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:58.166807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:58.167614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:58.169123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:58.177955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 17:30:58.177955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 17:30:58.177955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [parameters: {'id': '968441c293b341d48773e8386e0347b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 17:30:58.177955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:30:58.186044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return ref.to_dict() Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:30:58.186931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 17:30:58.187835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 17:30:58.188681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:30:58.189557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:30:58.190398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'id': '968441c293b341d48773e8386e0347b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:58.191268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 17:30:58.192060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:30:58.192882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 176/359] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Oct 17 17:30:57 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:30:58.198021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:58.329675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77920a9-f5c3-4e8d-90c7-33dbba5705ca None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:58.366743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:58.367384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:58.367713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:58.367986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:58.380451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2e190d40-069b-46fb-a963-c8de86f14984 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:30:58.386181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:30:58.387065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 17:30:58.387853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:30:58.390695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 184/360] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:30:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:30:58.393719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:30:58.506482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894bea-8070-4bf7-9643-c2340b1be7b6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:30:58.529369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:30:58.548734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:30:58.549354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:58.549735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:58.550011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:58.550682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:30:58.550985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:30:58.552356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc3abe-e814-42d5-925e-5db90ad048eb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:30:58.564756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 177/361] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:30:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:30:59.743315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52408a91-793c-4172-925c-4060fd7617f0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:59.743828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52408a91-793c-4172-925c-4060fd7617f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:59.743828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52408a91-793c-4172-925c-4060fd7617f0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:59.745234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 185/362] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:30:59.750958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b24d-3bfc-48c2-b15d-41c973229dbe None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:59.751390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b24d-3bfc-48c2-b15d-41c973229dbe None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:59.751582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b24d-3bfc-48c2-b15d-41c973229dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:59.778723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f0c7b24d-3bfc-48c2-b15d-41c973229dbe None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:30:59.779941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f0c7b24d-3bfc-48c2-b15d-41c973229dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:30:59.880504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 178/363] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:30:59.994993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ce2d-b4b3-4c7c-a776-4318ff5fa801 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:30:59.995244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ce2d-b4b3-4c7c-a776-4318ff5fa801 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:30:59.995577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ce2d-b4b3-4c7c-a776-4318ff5fa801 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:30:59.997286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 186/364] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:00.003316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ddd1-df47-445f-a8c1-ae57989326f5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.003600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ddd1-df47-445f-a8c1-ae57989326f5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.003875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ddd1-df47-445f-a8c1-ae57989326f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.023076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a7b7ddd1-df47-445f-a8c1-ae57989326f5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:00.024248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a7b7ddd1-df47-445f-a8c1-ae57989326f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:00.097876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 179/365] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:00.299038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ce2d-b4b3-4c7c-a776-4318ff5fa801 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.302016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:00.375985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fb44-a6db-4d34-87c3-807e1c4e163d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.376308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fb44-a6db-4d34-87c3-807e1c4e163d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.376529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fb44-a6db-4d34-87c3-807e1c4e163d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.378145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 180/366] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:00.381267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17fb44-a6db-4d34-87c3-807e1c4e163d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.431977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ce2d-b4b3-4c7c-a776-4318ff5fa801 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:00.433649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:00.482455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:00.483097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.483384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.483655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.495276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-45f9ccca-ae7c-4065-b04f-42b54459fcaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:00.500801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:00.501733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:00.502514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 187/367] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:00.503917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.504209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.504487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.519154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17fb44-a6db-4d34-87c3-807e1c4e163d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:00.524194 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:00.525655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:00.557502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:00.558532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.559234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.559926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.571172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:00.576300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:00.577475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:00.578468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:00.586141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 181/368] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:00.586141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.607105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:00.610236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 188/369] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:00.613700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.773686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:00.778112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd332ff-616d-4086-8259-5f15dcd5b00f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:00.797752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef54e-1c35-41c0-8241-c36e56637633 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:00.845038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:00.845841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.846117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.846386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.847048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:00.847349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:00.848906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:00.868109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:00.869147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:00.869642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:00.870187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:00.871282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:00.871792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:00.873501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:00.878477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 182/370] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:00.883431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 189/371] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:00.888103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.889471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:00.986814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.039788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d639aea-5c43-437c-b34c-a314cddffd32 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.046540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15427-4d48-4849-b725-7043cc32f39a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.076709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.077459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.077864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.078278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.089746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.090738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.091201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.091397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.091664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.091934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:01.106931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.107837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:01.108775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:01.108775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.108775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:01.108775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 190/372] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.108775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.109711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.111492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-114b3160-5380-4e91-a1b0-02a404c527ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:01.128158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.129310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:01.130430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:01.130430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.130430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:01.136424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 183/373] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.137895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5365f2c-27ef-4a28-9f69-c0f61dbd25f1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.138342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5365f2c-27ef-4a28-9f69-c0f61dbd25f1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.138609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5365f2c-27ef-4a28-9f69-c0f61dbd25f1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.141633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 184/374] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:01.141633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5365f2c-27ef-4a28-9f69-c0f61dbd25f1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.159860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.221464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02bbc1-5ba2-4e41-8773-265e112b486d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.228828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.256047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5365f2c-27ef-4a28-9f69-c0f61dbd25f1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.259753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.260391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.260668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.260936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.272927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:01.277886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.278781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:01.279650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 191/375] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.280302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.294040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.294763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.295043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.295318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.295962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:01.296337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.297650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16194-ae3f-4601-9b8d-cc93636c5aa4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.310420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 185/376] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:01.311440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.311716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.311977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.330372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:01.331661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:01.394992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f4bc-eed0-4a1c-a5f2-bec1eb7df113 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.413662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 186/377] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:01.413662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.422976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.446805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.447965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.448248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.448512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.449166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:01.449469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.451317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.471101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 192/378] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:01.472730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.502744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.535165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5f89-a992-459c-8731-0ace989e5335 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.572814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.573434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.573868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.574134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.574913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:01.575215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.576711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907bdb5-e2fe-40ad-97a3-38e37641723a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.580239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614a1d8-6325-4634-845b-8d345a1c5f34 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.593292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 187/379] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:01.593292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf31158-0d69-4ffd-b230-0921de5a8ff5 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.593292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf31158-0d69-4ffd-b230-0921de5a8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.593292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf31158-0d69-4ffd-b230-0921de5a8ff5 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.597636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 188/380] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:01.597636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf31158-0d69-4ffd-b230-0921de5a8ff5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.619294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.619950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.620224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.620491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.628647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.630189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:01.642677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.643618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:01.644519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 193/381] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.646042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.670856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.709931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf31158-0d69-4ffd-b230-0921de5a8ff5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.735033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.744572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.745247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.745521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.745835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.750908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e237a-d4ff-4018-b46a-c42c58812bd6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.753820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.755256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ac2d0c0c-f47d-49d7-8454-72e75dc94533 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:01.767852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.768870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:01.769791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 189/382] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.770447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.770447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.770627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.788313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:01.789463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.789644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:01.790127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.790401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.790668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.801506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.802990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:01.817255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:01.818301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:01.819128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:01.819128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:01.819128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:01.819128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 194/383] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:01.819128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.861508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 190/384] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:01.866455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:01.924631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6ed9-e528-48ae-9424-c36d5ceb116f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.928730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:01.959381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:01.960031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:01.960307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:01.960574 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:01.961298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:01.961616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:01.963235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:01.977229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b78f-cd22-4e74-bf14-7965353a5cc8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:01.981218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.002205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 195/385] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.002833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.019704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.020361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.020644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.020916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.032464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:02.037058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.037989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:02.038800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 191/386] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.039519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.111616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7e30b-d288-4ad5-86b7-29cbd660e872 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.149316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.150057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.150434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.150766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.151575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.151880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.153325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.157691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a8383-43e2-4af9-8986-770c6df5a1f0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.171056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 196/387] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.171883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.177764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.192339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.192948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.193219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.193486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.194162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.194461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.195822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.207728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 192/388] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.208789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.231177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.276728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46d72-ec75-4c79-b1f5-1e20c727f6bc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.312677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.313171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4201-068b-4d1c-8b95-f93dd06f1b93 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.313303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.313598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.313865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.323921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.325374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:02.341013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.342104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:02.343248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:02.343248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.343248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:02.343248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 197/389] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.343248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.350250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.350884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.351163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.351434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.352103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.352406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.353942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.362681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 193/390] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.363320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.403329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.450560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ea85-397c-4e9c-8f25-dfa311c7bf07 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.459625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.469182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e90804-9d47-417d-907e-451b9d2e204d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.488152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.488814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.489092 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.489365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.500039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.501514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.503677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.504305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.504573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.504841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.515309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.516814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:02.517445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.518514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:02.524525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:02.524525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.524525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:02.524525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 198/391] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.524525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:02.531369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.532279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:02.533125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:02.533125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.533125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:02.533125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 194/392] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.533331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.624469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.625674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e513-b1c2-44ad-b7dd-0f810c18c0d0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.634990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532424-97c6-4466-92a1-84d8f14b9a4b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.660076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.660747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.661021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.661277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.668652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.670179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.671889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.672517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.672794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.673064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.673746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.674046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.675382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:02.681968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.682857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:02.683731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 199/393] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.684305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.694875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 195/394] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.694875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.704186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.789605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdfacc-b262-4396-aa86-a9f96641946c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.792274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5755493-c962-40a3-b347-b68d46471a00 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.824074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594693e8-0179-404e-8600-537e538f268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.824683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594693e8-0179-404e-8600-537e538f268d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.825018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594693e8-0179-404e-8600-537e538f268d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.825347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594693e8-0179-404e-8600-537e538f268d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.827802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.828719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.829001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.829270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.829941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.830241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.831618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.835502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594693e8-0179-404e-8600-537e538f268d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.836946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594693e8-0179-404e-8600-537e538f268d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.843275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 196/395] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.844172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-594693e8-0179-404e-8600-537e538f268d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:02.851941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:02.852872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:02.853813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:02.853813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:02.853813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:02.853813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 200/396] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:02.854738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594693e8-0179-404e-8600-537e538f268d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:02.858700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.928815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:02.945333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef5b38-a94e-4738-a734-0f8737a6889e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.961345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594693e8-0179-404e-8600-537e538f268d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:02.980808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:02.981413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:02.981720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:02.981988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:02.982619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:02.982915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:02.984265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:02.996297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 197/397] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:02.997177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.002980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.003606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.003890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.004166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.004907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:03.005214 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.007108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.025350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 201/398] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:03.026251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.073710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.106504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195ebff-18e6-46cf-a66e-a99f8f1d99e9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.132828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443338f9-d607-46b6-b678-5e05d25e6320 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.140687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.141316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.141615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.141890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.148376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.149841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:03.161564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:03.162494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:03.163350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 198/399] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:03.164137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.164209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.177013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.177666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.177938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.178207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.178853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.180308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.201856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 202/400] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:31:03 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:03.202769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.279433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb43c-5863-4788-916a-b096105bf834 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.313203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.320082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.320798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.321441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.321441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.322116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:03.322415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.323882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.335189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06657-766d-4ec5-aeec-d1247ea56180 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.337629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 199/401] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:03.338571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.379731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.380278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.380554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.380818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.389188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.390894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:03.403800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:03.404696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:03.405651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 203/402] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:03.406110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.459170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429bde-e8bc-40d4-8ce2-c1b464273186 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.464966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.497342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.498159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.498531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.498866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.510271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.511720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.526884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e878249-bf22-4ff0-8364-162a3d2346b9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:03.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:03.528920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:03.529843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:03.529843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:03.529843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:03.530533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 200/403] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:03.531041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.566568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.567204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.567744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.568018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.568923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:03.569027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.570467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.577761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.591585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 204/404] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:03.592433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.643778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067cb0d-70aa-47e0-bf73-d00a5b2ef858 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.681546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.682290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.682682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.682958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.691453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.692883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.696572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4965-5b68-46a4-a54c-bb95d6551598 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.700410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:03.706437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:03.707303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 201/405] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:03.708174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.746511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.747316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.747421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.747649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.748342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:03.748770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.750888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.771966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 205/406] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:03.771966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.811541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b256-0726-4fde-b97b-2a77319f1c33 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.813962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:03.853477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.854333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.854617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.854898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.855543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:03.855846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.857727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.876995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 202/407] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:03.876995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.887180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56700-73b8-42cf-9e01-6e00ccaa69c2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.926195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:03.927113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:03.927850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:03.928137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/ea10fd96c9fa48809e2dfa85b11d8d11/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:03.945154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=ea10fd96c9fa48809e2dfa85b11d8d11, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:03.946652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:03.961624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 206/408] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:03 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/ea10fd96c9fa48809e2dfa85b11d8d11/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:03.962748 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:03.988625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5d35-61af-4630-ab14-098789e64231 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:03.993008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.039267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.040228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.040712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.041474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.042615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:04.043065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.045122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.097462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac26d-a876-4cc8-a992-89cfe3e7fd2c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.097932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 203/409] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Oct 17 17:31:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:04.099265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.138409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.151078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.151933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.152298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.152676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.172239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=dd4de9ba564044ab8a8f835faae23ab6, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.174211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.190418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 207/410] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:03 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:04.191299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.257431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b48df9-3717-4c1d-9c15-f2ff683af815 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.322267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.334405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.335353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.335955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.336392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.358743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.360251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:04.373789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:04.374677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:04.375830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 204/411] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:04.381456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.399739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968edc-60aa-4b4a-89f0-42528f62260b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.448634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.449410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.450015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.450360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.463854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.465338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:04.483297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:04.484255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:04.485073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:04.485073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:04.485073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:04.485073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 208/412] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:04.493534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.497961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.544867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66942b-cc08-47a5-add1-7b64355d6511 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.612252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.612885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.613162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.613433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.614166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:04.614471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.615906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.651449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 205/413] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:04.658179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.671219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2266-ab5f-4103-846c-e71a3f88fd7d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.711050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.737397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.738044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.738326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.738594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.739247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:04.739552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.740927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.764420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 209/414] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:04.770068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:04.845017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e501-1aff-4126-a9a7-e5f8ac5d51d5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.910760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:04.911344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:04.911619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:04.911887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/cb97ad1bfae943289b1b967065937396/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:04.934341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:04.941531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=cb97ad1bfae943289b1b967065937396, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:04.942996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:04.951218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0a8b-29bf-468b-8f66-a0e2022f71f6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:04.967009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 206/415] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:04 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/cb97ad1bfae943289b1b967065937396/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:05.016525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:05.017184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:05.017515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:05.017816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:05.031052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:05.032565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:05.046794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:05.047686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:05.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 210/416] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:05.053765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:05.189466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69b01-2959-4673-b606-018ac65096b5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:05.235946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:05.236630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:05.236908 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:05.237177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:05.237936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:05.238240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:05.239708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7821-be91-44f1-9920-604ccf8789b0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:05.256230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 207/417] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:05.262422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:05.305611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:05.379116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6a82-0a08-4453-9dc2-200ed6f46aeb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:05.427888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:05.428573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:05.428889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:05.429181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/9d909083488f4a8c9ef7bd628c801950/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:05.459378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=9d909083488f4a8c9ef7bd628c801950, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:05.460905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430313d7-db5f-48f4-8f94-8e81e4d2aa66 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:05.484208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 211/418] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:05 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/9d909083488f4a8c9ef7bd628c801950/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:05.582299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e55bb-c649-434d-b56e-b9675060a886 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:05.582629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e55bb-c649-434d-b56e-b9675060a886 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:05.582836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e55bb-c649-434d-b56e-b9675060a886 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:05.584526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 208/419] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:05.590644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:05.592069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:05.592345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:05.613244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:05.614481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:05.693787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 212/420] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:06.058676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e55bb-c649-434d-b56e-b9675060a886 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:06.122113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:06.186294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e55bb-c649-434d-b56e-b9675060a886 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:06.235657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:06.236672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.237140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.237615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.254276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-cef826dc-2bac-4c36-a808-b312e96c31ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:06.259932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:06.260816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:06.266043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:06.268095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 209/421] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:06.274439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:06.310142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:06.441054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a116-c0f8-4bc3-9290-024f86bd6872 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.441376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a116-c0f8-4bc3-9290-024f86bd6872 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.441620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a116-c0f8-4bc3-9290-024f86bd6872 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.443228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 210/422] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:06.449208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.449492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.449799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.464687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436b97-0a5d-4c89-b75e-62002ee89cf5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:06.481422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:06.484884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:06.534404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:06.535023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.535300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.535572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.536245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:06.536547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:06.537967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:06.553791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 213/423] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:06.559501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:06.603220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 211/424] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:31:06.709227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:06.737025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5ccd-53c8-4c65-8007-af031c022639 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:06.784480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:06.785150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.785427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.785738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.804401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:06.806021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0ef486ce-f694-433f-a727-cf98139a0166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:06.821125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:06.823391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:06.825525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:06.825525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:06.825525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:06.825525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 214/425] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:06.828436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:06.891866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:06.922472 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc831-9da2-4f1f-b6f5-e52e05b62913 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.923095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc831-9da2-4f1f-b6f5-e52e05b62913 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.923566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc831-9da2-4f1f-b6f5-e52e05b62913 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.925398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 215/426] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:06.930010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761729a2-0826-490d-8346-38f82aa89940 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:06.930514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761729a2-0826-490d-8346-38f82aa89940 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:06.930992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761729a2-0826-490d-8346-38f82aa89940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:06.955449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-761729a2-0826-490d-8346-38f82aa89940 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:06.958830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-761729a2-0826-490d-8346-38f82aa89940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:06.992127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeddeb-812a-477e-acc9-fa706377af92 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.030038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.031000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.031474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.031962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.032798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:07.033296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.034893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.047487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 212/427] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:07.052881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.060056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 216/428] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:07.061077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761729a2-0826-490d-8346-38f82aa89940 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.137935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.159438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.164645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e080a1-0b56-4990-941f-c37934ed23d3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.203350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.204335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.206107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.206629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.212222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761729a2-0826-490d-8346-38f82aa89940 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.228785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:07.234453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:07.235346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:07.236478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:07.244739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 213/429] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:07.247661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.283645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.285038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.285513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.286087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.301946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.303800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:07.334811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:07.335763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:07.336669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 217/430] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:07.357936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.400464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eceb8a-6c7c-418f-9bf2-31e98cd38d72 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.435897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.436833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.437309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.437803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.438706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:07.439205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.440781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.450483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 214/431] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:07.451812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.475026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560fee-65c5-450c-96f0-b254e7bba261 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.482666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.497430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.513717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.514529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.514903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.515263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.516088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:07.516488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.518078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.540795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 218/432] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:07.540795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.585811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a4c2-9bad-4f25-ba44-3a5ccc512b6b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.633751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.634772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.635475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.635895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.649771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:07.652300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2bdd-a0e4-4cd0-8e59-09488e552299 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:07.656979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:07.658104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:07.659083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:07.661324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 215/433] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:07.662268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.692146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.692926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.693300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.696335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.708954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.709879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:07.725404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:07.726491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:07.727342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:07.727342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:07.727342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:07.727342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 219/434] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:07.727703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.760681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.768482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:07.789602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4992e7-9d8b-4f01-a0d4-49dce394533d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.825240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.825938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.826187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.826459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.831358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55948e-617f-4656-8cc1-5e90404fe59e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.837698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.839275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0653c1e8-f51f-4cd1-8dc7-8185c29d50d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:07.854573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:07.855517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:07.856335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:07.856335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:07.856335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:07.856335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 216/435] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:07.856990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadd3a-fa4a-4652-b8c1-be4feb096a78 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.857266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadd3a-fa4a-4652-b8c1-be4feb096a78 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.857538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadd3a-fa4a-4652-b8c1-be4feb096a78 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.860793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 217/436] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:07.860793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadd3a-fa4a-4652-b8c1-be4feb096a78 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.879605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:07.880210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:07.880490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:07.880798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:07.881489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:07.881867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:07.883242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:07.893626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 220/437] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:07.893626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:07.974446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadd3a-fa4a-4652-b8c1-be4feb096a78 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:07.990287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.001310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9d3b-0073-4c2b-b772-946856d9eaa7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.010043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.010777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.010943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.011187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.011831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:08.012134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.013496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bfd97-eabf-472a-95d1-cb6ab0fa20d3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.015159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.032158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 218/438] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:08.032158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a483a-848c-4620-8437-37416a42788b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.032158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a483a-848c-4620-8437-37416a42788b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.032158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a483a-848c-4620-8437-37416a42788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.043249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.043847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.044139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.044416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.045060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:08.045362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.046764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.049396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-389a483a-848c-4620-8437-37416a42788b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:08.050634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-389a483a-848c-4620-8437-37416a42788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:08.059972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 221/439] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:08.061483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.125200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 219/440] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:08.126424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a483a-848c-4620-8437-37416a42788b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.187970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79d138-d37a-493c-8eb8-ef647eee0ddc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.225933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.226914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.227392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.227917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.241889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.243473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.259154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a483a-848c-4620-8437-37416a42788b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:08.263750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:08.264617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:08.265484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:08.265484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:08.265484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:08.267592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 222/441] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:08.268612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.277764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.291409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.303083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.303722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.304016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.304274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.312798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.314294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:08.327380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:08.328336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 220/442] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:08.329224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.382306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eee7-ac4f-428a-b240-6deec263bc24 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.416398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.417036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.417309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.417605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.424253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.425718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-98b9e953-6a33-41e9-ba68-47fdcc380360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:08.437123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:08.438151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:08.439083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:08.439666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796912cf-a678-40d1-b15f-408b79414fb7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.439747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 223/443] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:08.439747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a4fe-ac20-40f1-970b-1aa63dd9a3fb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.439747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a4fe-ac20-40f1-970b-1aa63dd9a3fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.439915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a4fe-ac20-40f1-970b-1aa63dd9a3fb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.441199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 224/444] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:08.446210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a4fe-ac20-40f1-970b-1aa63dd9a3fb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.479008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.479516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.479806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.480068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.480709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:08.481005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.482385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.499032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 221/445] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:08.499032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.512919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.545541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.553565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a4fe-ac20-40f1-970b-1aa63dd9a3fb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.590206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.590823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.591107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.591378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.592108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:08.592413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.593910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.602613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991c1b-6e02-4c98-8761-6b47a5ae7e43 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.611416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 225/446] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:08.612214 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.640312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.640934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.641206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.641472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.651730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2fdc5d24-0170-4cd9-b2dd-2dd894865040 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:08.656467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:08.657518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 222/447] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:08.662604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.663330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.663330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.677822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:08.679021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:08.724637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc82c5-a5ed-46d0-a6d4-f3c22e93e8eb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.746198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 223/448] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:08.746971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.748620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.760980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.761616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.761901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.762174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.763424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:08.763424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.764589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.781746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 226/449] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:08.781746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.802241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:08.879024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d5a41-5ccb-45fd-9d52-4844d7065128 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.884525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc208a0-16c1-4205-a827-43ff81459b0b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:08.919115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.919757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.920206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.920479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.921781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:08.922405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:08.922683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:08.922954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:08.928553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:08.930024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:08.941596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:08.942526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:08.943405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 224/450] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:08.943987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:08.984627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.006148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.007567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.042641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.049161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f808-2cc7-40ea-8bfa-d20d99f0bc36 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.083980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.084576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.084848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.085112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.085800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:09.086103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.087465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.096204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 225/451] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:09.096993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.111152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 227/452] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:31:09.111865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.192863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.201480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1e9f-ca00-42be-9f4e-57601c14b584 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.211967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412d07-32f3-4775-acbe-6a52e64eed3c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.237103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.237798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.238088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.238359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/e33fc4dc7ed74e7bb07e5746aa17e254/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.246892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.247480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.247751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.248014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.248735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:09.249034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.250818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.253428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=e33fc4dc7ed74e7bb07e5746aa17e254, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.254877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.268895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 228/453] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:09.277761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 226/454] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:09 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/e33fc4dc7ed74e7bb07e5746aa17e254/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:09.278376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.278472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.288661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.401029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae23c7-259a-4223-8935-3ceb5ba6c19b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.401251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea773-3bc2-4fce-a4a6-41ac8d66036a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.445103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.445103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.445103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.445103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.453409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.454350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.454350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.454612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.458829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.460293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.464922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.468478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:09.473844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:09.474728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:09.475513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:09.476890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:09.477800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:09.478840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:09.478840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:09.478840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:09.478840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 227/456] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:09.483906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.484350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 229/456] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:09.484350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.548996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.595999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd02695-04f5-4734-9563-9f8f211196de None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.597987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdadb-c3aa-42fa-aa7e-584cdd593be5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.636491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.637104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.637384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.637483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.637708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.638080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.638359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.638659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.652456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.654130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:09.670364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:09.671271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:09.672121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:09.672121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:09.672121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:09.672121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 228/457] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:09.672328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.712819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.715248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.717032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.787320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094962-b820-4e39-9deb-904d8f89cab7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.798776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.824958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.825461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.825770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.826046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.826693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:09.826999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.828363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 230/458] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:31:09.829003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.832857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.852339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 229/459] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:09.852339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:09.946096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:09.949716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a2fc8-bbe9-4e76-afc0-0f08b0dde106 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.958850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322de16-0d98-418a-b3ce-ba89ab3d9e2d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:09.987112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:09.987731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:09.988013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:09.988283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:09.988942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:09.989245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:09.990654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:09.998923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.004552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 231/460] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.004684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.004684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.004684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.004900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.004979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:10.004979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.004979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.022512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 230/461] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.022512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.054849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.112296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521450-56b6-40e8-bac3-8c7ec91d48a3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.133242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70075da-1fbe-4689-aaa7-6841c4b0c125 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.150863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.151500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.151922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.152165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.164269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.166159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.172004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.172706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.173398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.173757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:10.180868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:10.181842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:10.182682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:10.182682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:10.182682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:10.182682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 232/462] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:10.183439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.187365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.188809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:10.201086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:10.202129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:10.202996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:10.205258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.207186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 231/463] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:10.208208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.297639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88525e-7707-41a8-a1eb-fe33da748894 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.303426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.315401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbc78-841d-4a53-bedf-143d914eeffb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.332985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.333864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.334140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.334689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.346336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.347790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.350747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.351378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.351654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.351923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.359210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.360637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:10.361987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:10.362920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:10.363767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:10.363767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:10.363767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:10.363767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 233/464] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:10.363981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:10.378917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:10.380002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:10.380861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 232/465] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:10.381335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.434613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.474504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316972f-eb78-48b3-976e-86c50319dd87 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.501512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38d76-37a2-4ecd-9f09-46cc2a58e442 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.509668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.510453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.510591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.510825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.511463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:10.511766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.513192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.525081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 234/466] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.525960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.544407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.545316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.545817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.546256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.547128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:10.547575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.549163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.568563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 233/467] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.569656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.584698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.635149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb546bd-a3e8-4d71-98d2-828586fc1f7f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.662510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.671808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.672420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.672697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.672963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.673650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:10.674009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.675375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.686908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 235/468] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.687703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.693665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd085d-d04a-441a-bab4-1dd7e5fa9a00 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.730679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.731377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.731568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.731827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.732516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:10.732814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.734290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.746393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 234/469] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:10.750792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.801566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23b186-ae16-404a-b39b-96479cc4f6aa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.821672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.836513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.837149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.837450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.837949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.845698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.847139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:10.859681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:10.860529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:10.861395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 236/470] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:10.862628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:10.864960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28611508-ae55-4ebd-9fcf-d6e0573ff908 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.903457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:10.904001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:10.904262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:10.904530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:10.913520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:10.967842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78cbc5-3b67-470e-b2c8-2a7d41400ce0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:10.980794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:10.982587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.002256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.002891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.003169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.003439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.011468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.013058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:11.024445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:11.025422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 237/471] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:11.031929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.059505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.098887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 235/472] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:31:11.099753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.144321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f4d8-d16c-43d3-8b98-7f5cb893c22b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.152245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.181255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.182071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.182179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.182434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.183156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=ea10fd96c9fa48809e2dfa85b11d8d11) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:11.183462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.184892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.197610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 238/473] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/role_assignments?user.id=ea10fd96c9fa48809e2dfa85b11d8d11&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:11.197610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.220775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02934-5452-4e54-983c-43ef23e9e601 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.260380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.261021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.261301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.261595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.262404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:11.262717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.264214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.283147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 236/474] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:11.283147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.324488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.360200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a360-5916-4019-9db6-89388d9b4599 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.406802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.407561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.407844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.408117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.408861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:11.409323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.410814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.416451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f0d9-4682-4281-bb69-afb5578898d8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.430096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 239/475] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:11.430778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.461826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.462943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.462943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.463227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.465479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.475280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.476389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d3645c76-7f9a-4b18-bce2-12940f09d38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:11.492213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:11.493148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:11.495579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:11.495579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:11.495579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:11.495579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 237/476] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:11.495790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d8ce-f437-47fb-8715-43c7a05ca5c9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.497923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d8ce-f437-47fb-8715-43c7a05ca5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.497923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d8ce-f437-47fb-8715-43c7a05ca5c9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.497923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 238/477] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:11.498261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d8ce-f437-47fb-8715-43c7a05ca5c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.548498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7667289-ca84-46cb-8b17-37de6c48bfc7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.582938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.583577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.583860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.584130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.584862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=dd4de9ba564044ab8a8f835faae23ab6) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:11.585168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.586628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.590968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.593897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 240/478] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/role_assignments?user.id=dd4de9ba564044ab8a8f835faae23ab6&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:11.594822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.626023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d8ce-f437-47fb-8715-43c7a05ca5c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.675547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.676524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.676938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.677414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.725645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.738360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3337-971a-4760-94a4-bb429ed6536f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:11.776713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.778768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.789053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:11.790025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.790657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.791263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.792451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:11.792762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:11.794216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd926-d060-4a66-88a1-949c025ff104 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:11.809681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 241/479] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:11.811016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:11.811304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:11.811577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:11.835000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:11.836169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:11.882789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:11.904810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 239/480] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:31:11.905914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:11.940843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 242/481] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:11.941838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.037606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.061672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e139f8-a612-4cd3-b1a9-b7a8ebc65292 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.126180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81025b89-866e-407a-bd68-c62606fb36be None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.131405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.132056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.132375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.132635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.158031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.159509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:12.190921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:12.191864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:12.192698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:12.192698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:12.192698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:12.196704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 243/482] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:12.205694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.209473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.210145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.210423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.210692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.227966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.229569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:12.245350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:12.246254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:12.247170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:12.255898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 240/483] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:12.258655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.318743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.348719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e78a03-4eeb-4954-9f2b-3ebbfacd39df None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.385627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.386412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.386537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.386784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.387433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:12.387737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.389119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.390949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.408277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 244/484] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:12.408277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.408522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0d39-ecfc-4f2a-9d5e-f31f68a94f4d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.450157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.450808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.451090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.451362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.464449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:12.469825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:12.470812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:12.471627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:12.477847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 241/485] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:12.480595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.549616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98a324-2cc0-40ef-b176-f113aff3bba0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.591013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.591352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.591627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.591898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.592608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:12.592942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.594412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.614114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 245/486] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:12.615177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.617609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.623402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0ec7-f558-4065-af74-b91d38df3aea None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.671325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.672062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.672369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.672643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.680161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.681864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.686357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:12.695170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:12.696017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:12.696940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:12.701524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 242/487] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:12.702427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.746930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd356d7-d92b-45fe-b570-887144b189ae None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.784006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.784638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.784920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.785256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.785972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:12.786705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.787718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.801792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 246/488] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:12.802727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.825339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d52c2-4cd6-4675-af8b-4f406c55b99a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.867731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.868343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.868620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.872374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.873128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=cb97ad1bfae943289b1b967065937396) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:12.873441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.876856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:12.890047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 243/489] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/role_assignments?user.id=cb97ad1bfae943289b1b967065937396&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:12.891046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:12.931581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18312a-3853-43fd-ab6f-d87692c13b4f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:12.947668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.959353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:12.988512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:12.989618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:12.991440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:12.992391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:12.993624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:12.994433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:12.996372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.014061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 247/490] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:13.020630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:13.127900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbbce-aea6-4271-a0f3-9e6bd5038103 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:13.175607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:13.176657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.177156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.177670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.190867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:13.192849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:13.209941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:13.210866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:13.212115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:13.212115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:13.212115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:13.212359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d20df-ed74-42b4-a7b9-1b90e3d5ad45 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:13.214385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 244/491] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:13.222092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:13.258634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:13.259249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.259958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.260323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.261189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=9d909083488f4a8c9ef7bd628c801950) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:13.261542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:13.263172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.270367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 248/492] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/role_assignments?user.id=9d909083488f4a8c9ef7bd628c801950&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:13.316021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:13.350782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe38ef-bc7f-4b65-8c16-ac14ba5c4a84 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:13.396829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:13.397820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.398299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.398764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.399650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:13.400271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:13.401953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa8dfd-688d-474d-8f85-4c4b3aac7f04 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.421014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 245/493] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:13.423222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:13.459404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdd6a-3261-4d9b-af1a-9dcc02715f05 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.459785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdd6a-3261-4d9b-af1a-9dcc02715f05 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.460059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cdd6a-3261-4d9b-af1a-9dcc02715f05 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.461864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 246/494] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:13.471643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.471979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.472195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.486680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:13.506759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:13.508340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:13.598716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75645fe-467d-4bd2-b9c0-2d31f6fe270e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:13.618757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 247/495] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 17:31:13.637530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:13.638436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.638853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.639285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.647657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:13.649262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:13.662109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:13.663241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:13.664521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:13.666704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 249/496] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:13.672546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:13.768883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:13.817715 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f30ff-5f2a-433f-8cf4-a15e01671314 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:13.866393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:13.867016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:13.867291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:13.867560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:13.868309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:13.868650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:13.875189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:13.899005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 248/497] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:13.905083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:13.936005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.040413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.043715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95bf7-49fd-4fd5-80cb-9962e7079f61 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.088640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37a45a-e103-4c2d-b5fa-17b6853998a1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.094971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.095712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.096292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.096562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.121218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.138372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.139194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.139562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.139927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.151670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.153167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5674ec50-74bd-4da1-966a-63b4360471f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:14.170428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:14.171603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:14.172483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:14.172483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:14.172483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:14.172483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 249/498] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:14.178452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f42b-5c04-4242-827a-d69f2d299f27 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.178896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f42b-5c04-4242-827a-d69f2d299f27 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.179306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f42b-5c04-4242-827a-d69f2d299f27 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.182152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 250/499] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:14.183353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f42b-5c04-4242-827a-d69f2d299f27 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.192697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.194317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3039-1f22-4863-b792-b19f868060ba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.310747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f42b-5c04-4242-827a-d69f2d299f27 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.328205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.333902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 250/500] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 17:31:14.335580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.335997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.336393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.353444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.354277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.354644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.355009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.355884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:14.356265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.356780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:14.357838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.358320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:14.377621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 251/501] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:14.379183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.418399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.450186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 251/502] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:14.451376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.502113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e395f0-c0d9-42c1-b91b-39ed5dbbc2e0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.544768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.546395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.546874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.547772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.561214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.563132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:14.580285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:14.582057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:14.582945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:14.582945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:14.582945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:14.584313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2669e-7d53-4798-b802-a009014376b1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.585258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 252/503] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:14.593828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.643356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.657135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.658168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.658643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.660351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.661206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.663089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.704888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 252/504] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:31:14 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:14.740089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:14.763004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3568-6e50-45b0-b2f7-56e8af1ec2eb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:14.792935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.808973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:14.809747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:14.810480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:14.810806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:14.811631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:14.811998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:14.817608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:14.831446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 253/505] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:14.837226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:14.990052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce767074-1044-40cf-88cf-5a2410017dc2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.012805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30826f-4d9c-4b75-8da7-926cfc0a93ef None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.028939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.029660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.029940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.030303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.042270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:15.048308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:15.049243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:15.050108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 253/506] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:15.059726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.060111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.061002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.061467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.061996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.070091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.071826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:15.083633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:15.084622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:15.085509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:15.087515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 254/507] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:15.098768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.113234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:15.124631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:15.224815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9d70-440c-4bde-b915-65e4a6dcd592 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.289447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784a6d-9f39-4e32-bc95-d6a8cbbd78e1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.292336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.292966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.293239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.293646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.294329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:15.294628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.296290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.313854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 254/508] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:15.320712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.355696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.356425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.356703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.356978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.357709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:15.358036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.363338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.387336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 255/509] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:15.394539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.501934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:15.537209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94baf-c102-49a5-bc18-2b260a53da92 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.552023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e57c-3d6b-4c2b-9329-f5624bd64b7e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.575919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:15.576850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.577978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.578513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.580109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.581057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=e33fc4dc7ed74e7bb07e5746aa17e254) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:15.581505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.583231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.591165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 256/510] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/role_assignments?user.id=e33fc4dc7ed74e7bb07e5746aa17e254&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:15.637804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.638513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.638793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.639065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.662188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.663665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f5ac755c-8d93-4976-9b0c-6cc6cd898159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:15.690255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:15.691457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:15.692631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:15.692631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:15.692631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:15.692631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 255/511] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:15.698000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.758207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538d43-99e6-47cd-a3a6-873284295ad4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.758496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538d43-99e6-47cd-a3a6-873284295ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.758753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538d43-99e6-47cd-a3a6-873284295ad4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.760753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 256/512] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:15.766576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694111-8336-4e42-a963-e5232d20ca13 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.766958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694111-8336-4e42-a963-e5232d20ca13 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.767368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694111-8336-4e42-a963-e5232d20ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.806686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-da694111-8336-4e42-a963-e5232d20ca13 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:15.808222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da694111-8336-4e42-a963-e5232d20ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:15.884418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6eff-c173-460e-b2b1-c5cd2ef945b0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:15.896580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 257/513] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:15.918008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:15.922478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c9d53-6ba1-4e9d-bb0d-190436499ea7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.922987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c9d53-6ba1-4e9d-bb0d-190436499ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.923404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c9d53-6ba1-4e9d-bb0d-190436499ea7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.925175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 258/514] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:15.926050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:15.926664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.926938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.927203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.927840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:15.928134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:15.929479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:15.935908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:15.936765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:15.936765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:15.947994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 257/515] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:15.955914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:15.961543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:15.962971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:16.046531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 259/516] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:16.080028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96727-b299-4853-a67f-ee1b07701c9e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.115900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.116529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.116852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.117120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.125029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.126526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:16.138641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:16.139796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.140940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 258/517] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:16.145834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.168535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.178420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.244819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.299647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749937-cd87-4fd7-8ffa-602160a263b3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.307972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be5ff-acd9-4080-9818-2fe0ab7797e7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.336971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.337969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.338250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.338518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.339104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.340463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:16.353091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:16.355469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.356483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 259/518] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:16.364861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.390451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.390996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.391272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.391544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.392277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:16.392572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.395551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.432200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 260/519] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:16.443269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.527591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b284b0-1ad6-4257-9e66-e7da531c9617 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.540278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.548086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.569293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.569996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.570279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.570550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.571189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:16.571485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.573036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.573992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb71f-b660-4a01-9cca-f5f3be7c4c44 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.584091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 260/520] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:16.584985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.619824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.621125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.622051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.622800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.637715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.640171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:16.662293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:16.663739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:16.664635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:16.664635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:16.664635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:16.667430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 261/521] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:16.669412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.707325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91110b-ebfe-4b95-a101-a8ec4fb34e3e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.749952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.752167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.752658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.753132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] PATH_INFO: `/v3/services/network` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.753957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.755575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:16.767909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:16.768963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:16.769838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:16.773413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 261/522] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:16.774532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.784428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36330-fb67-4a94-a4f8-7b5b1b2b300f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.815382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.821301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.822024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.822369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.822593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.823310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:16.823615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.825144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.837161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:16.838049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 262/523] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:16.839478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:16.907292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a799b-3d66-41c5-a2e2-98622ac4fe53 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:16.954689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:16.955779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:16.956261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:16.957085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:16.958408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:16.958955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:16.961417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:16.993230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 262/524] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:16.999459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:17.060462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a532e2-c139-457c-be98-59fa7c11b7b7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:17.118247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:17.118975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.119268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.119545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.120220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:17.120524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:17.122000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:17.127556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 263/525] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:17.133292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:17.159192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99075a-4056-4a07-b62c-8ae6137fd82b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:17.162769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:17.203373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:17.204418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:17.205418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.206036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.206518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.216186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:17.219190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:17.232320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:17.233269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:17.234180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:17.236978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 263/526] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:17.242258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:17.277980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cffd6a-7f27-4825-b3dc-6fb2129fabf6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:17.326904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:17.328212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.328695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.329227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.331227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] RBAC: Adding query filter params (type=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:17.331761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:17.333344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb83fc-cd05-4c95-8bef-c39d74dc4d58 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:17.340660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 264/527] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:17.342682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59ba57-23ab-4474-a378-b85a7db24c66 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.343203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59ba57-23ab-4474-a378-b85a7db24c66 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.344528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59ba57-23ab-4474-a378-b85a7db24c66 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.347728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 265/528] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:17.359566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.360397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.361075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.370130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2204-ff36-4d0a-8ed3-1a922dc10e9b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:17.410856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:17.412434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:17.414574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:17.415286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.415936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.416278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.425608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:17.425608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:17.425608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:17.433955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 264/529] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:17.446166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:17.480696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:17.574507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 266/530] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:17.595686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfed0-4acd-4f33-8147-26bc05a048eb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:17.649500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:17.650731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:17.651271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:17.651853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:17.654289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=dd4de9ba564044ab8a8f835faae23ab6, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:17.656184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:17.679578 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 265/531] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:17 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:17.932283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.003182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:18.054590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1700d0-fc64-4b67-bb3c-5ee3bc9ec568 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:18.093475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:18.094152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.094492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.094781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.106074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:18.111042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:18.112038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:18.112871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:18.117247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 267/532] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:18.118723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.209163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:18.229158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c54b4f-434c-4ce2-9344-e5758b325207 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:18.269702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:18.270315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.270589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.270858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.271580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:18.271881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:18.273239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea6530-812a-435c-ad72-0c5c60914cc6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:18.286737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 266/533] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:18.288168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.383055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8380ac-f936-464c-ad8b-24434c0da0ad None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.383396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8380ac-f936-464c-ad8b-24434c0da0ad None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.383610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8380ac-f936-464c-ad8b-24434c0da0ad None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.386229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 267/534] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:18.390806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.391090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.391364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.400483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4e9d-03f0-4c09-960a-55abc07fb1eb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:18.417929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:18.430599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:18.431860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:18.436007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:18.436653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.440087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.440087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.453050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:18.454954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:18.473690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:18.474669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:18.475807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:18.475807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:18.475807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:18.475807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 268/535] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:18.480632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.571919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 268/536] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:18.635867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a8f-ea10-49a6-bbf6-f66335e3239c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:18.671017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:18.671630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.671907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.672177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.672822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:18.673122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:18.674602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:18.687590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 269/537] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:18.694927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.775008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:18.806907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be559f9-9029-4d43-8622-908dc30036d5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:18.856252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:18.856898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:18.857171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:18.857441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:18.875101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:18.876567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:18.892297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:18.893412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:18.894373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:18.897711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 269/538] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:18.899589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.943319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:18.946993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.077465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a440ae-0052-46f6-8d6e-8f13aef679cf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.112843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e059c1-5c55-44c1-95e1-8f718d41aba5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.158549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.159235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.159509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.159777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.162617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.173318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:19.174298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.174928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.175203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.175476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.176212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:19.176515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.177978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:19.179046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:19.179940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:19.180758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:19.184930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 270/539] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:19.186718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.223852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 270/540] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Oct 17 17:31:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:19.230563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.295149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88da8-898c-4399-a6ec-d4e28931abc3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.358968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.359775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.360120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.360489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.361366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:19.361762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.363296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.388588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 271/541] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:19.407930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.408876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.442928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1408b-3ed1-48e5-bb8b-2e65299a901a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.488370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.489148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.489425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.489831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.492639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.503679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.505235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-14cc0aa3-eb50-4537-adda-e3346f7b9f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:19.521359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:19.522609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:19.523941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:19.523941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:19.523941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:19.523941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 271/542] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:19.524387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f79890-7f22-48b0-8829-6d05f2e8bb84 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.526204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f79890-7f22-48b0-8829-6d05f2e8bb84 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.526204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f79890-7f22-48b0-8829-6d05f2e8bb84 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.530743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 272/543] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:19.531404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f79890-7f22-48b0-8829-6d05f2e8bb84 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.547515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6cd7-0565-4d6f-a5f1-523b8315e79f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.596892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.598548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.599129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.599833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.616811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.618632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f70d93a9-057f-4f0c-bbe5-e6ea8c03263b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:19.639559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:19.640577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:19.641463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:19.641463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:19.641463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:19.643914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 272/544] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:19.645360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.645863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.646263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.661499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f79890-7f22-48b0-8829-6d05f2e8bb84 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.668317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:19.669673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:19.704686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.705470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.705893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.706261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.707057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:19.707527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.709032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.710795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.724511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 273/545] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:19.726136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.765875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 273/546] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:19.766924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:19.836352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:19.875817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2399c90-e796-4f8b-b539-595c0f742706 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.943179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea917bc-8231-4fcd-9e69-34b290239430 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:19.947538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:19.948164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:19.948440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:19.948710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:19.949358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:19.949774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:19.951188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:19.982042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 274/547] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:19.983120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.023667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.024357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.024637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.025128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.035861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.037546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:20.064262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:20.065306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:20.066562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 274/548] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:20.072612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.092695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.143141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e2d4c-7c6a-471c-be11-3ed4142a721b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.184814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.185447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.185760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.186034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.194937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.196381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.203829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.207503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1d43f-dcd8-4084-9c87-a5d4a1f016c8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-14e98fc9-5c1c-4d20-a3ea-b62b3cbacdd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:20.209345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:20.210476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:20.211422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 275/549] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:20.212022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670448-f17b-4f48-9a8d-5a984ab000d9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.212022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670448-f17b-4f48-9a8d-5a984ab000d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.212251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670448-f17b-4f48-9a8d-5a984ab000d9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.217620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 276/550] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:20.217620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670448-f17b-4f48-9a8d-5a984ab000d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.256961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.257566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.257867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.258239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.258825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:20.259240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.260675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.277547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 275/551] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:20.277547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.336290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670448-f17b-4f48-9a8d-5a984ab000d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.352554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.380169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.380973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.381251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.381525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.382426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.384536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd48de2-7f8a-4755-9a7e-f5b07ffe0111 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.389916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467a059-2c4a-4386-ace4-b0ede437020e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.415236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 277/552] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:20 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:20.415236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545f86a-98e8-4882-bb1f-be3f9881d16f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.415236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545f86a-98e8-4882-bb1f-be3f9881d16f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.415236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545f86a-98e8-4882-bb1f-be3f9881d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.435168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d545f86a-98e8-4882-bb1f-be3f9881d16f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:20.436394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d545f86a-98e8-4882-bb1f-be3f9881d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:20.475160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.475993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.477107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.477490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.480308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:20.480854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.482955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.512791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 276/553] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:31:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:20.513814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.526763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 278/554] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:20.528797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f18e7-0938-46fa-8e45-55abefbac3e4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.529086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f18e7-0938-46fa-8e45-55abefbac3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.529358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f18e7-0938-46fa-8e45-55abefbac3e4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.531254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 279/555] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:20.532151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f18e7-0938-46fa-8e45-55abefbac3e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.536132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.649031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91380-8369-4f96-a6e3-eb4068c15dbc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.666552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f18e7-0938-46fa-8e45-55abefbac3e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:20.669638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.696277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.697289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.697606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.697884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/8b098d9fac6d480490d75473398369c9/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.713667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:20.714577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.714845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.715111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.716101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=8b098d9fac6d480490d75473398369c9, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.717855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2fb0-12a3-4503-8887-52fc64c9cf31 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.728584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:20.730537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:20.733101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 277/556] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:20 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/8b098d9fac6d480490d75473398369c9/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:20.742712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:20.742960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:20.743258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:20.750217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:20.751636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:20.753046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:20.753046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:20.753046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:20.754654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 280/557] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:20.760969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.767641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:20.768978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:20.842347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:20.856756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 278/558] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 17:31:20.857410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:20.998073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd406c4-08e2-4ba5-9fe1-fc26dcd3cc70 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.019162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf4849-157a-4976-adae-009cf3d9b1d4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.040935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815164-c182-499f-8912-5225f760ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.041771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815164-c182-499f-8912-5225f760ad27 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.042056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815164-c182-499f-8912-5225f760ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.042330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815164-c182-499f-8912-5225f760ad27 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.042983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815164-c182-499f-8912-5225f760ad27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:21.043290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815164-c182-499f-8912-5225f760ad27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.045595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815164-c182-499f-8912-5225f760ad27 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.059251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 281/559] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:21.064410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815164-c182-499f-8912-5225f760ad27 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.068278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.068957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.069233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.071254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.072154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.077368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.103597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:21.107005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 279/560] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:20 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:21.182650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.249526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815164-c182-499f-8912-5225f760ad27 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.277463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:21.339690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.340746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.341259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d9a0-0662-469f-92f4-fba6e3bb642c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.341539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.342085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.353153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.361612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:21.383033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:21.384006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:21.385548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:21.389062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 282/561] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:21.390470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.393834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.394495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.394775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.395044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.411126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:21.417139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:21.419922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:21.421274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 280/562] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:21.426556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.488600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:21.523386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0d6f-0c7b-4daa-9c8b-57cb5d6861f1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.549803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd66bd-ae4f-4351-b38a-f9ff4b7e16be None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.559816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.560434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.560815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.561088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.561804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:21.562111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.563669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.564278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:21.582672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 283/563] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:21.585676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.586589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.587287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.587601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.587951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.588727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:21.589029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.590535 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.600989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 281/564] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:21.607796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.698196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d395-aca3-40c3-ba16-b9ef227f081c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.720350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92ba-b74b-49a7-87bf-4ae70f067d07 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.731623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:21.737731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.738400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.738675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.738980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/e33fc4dc7ed74e7bb07e5746aa17e254/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.740914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=e33fc4dc7ed74e7bb07e5746aa17e254, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.742456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.760269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.761202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.761688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.762174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.764571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 284/565] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:21 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/e33fc4dc7ed74e7bb07e5746aa17e254/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:31:21.775202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.777643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:21.794291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:21.795287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:21.796155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:21.796155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:21.796155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:21.798513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 282/566] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:21.804523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:21.924009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c060e-ab22-423c-8668-608018254e7c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:21.964114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:21.964806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:21.965085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:21.965355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:21.966032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:21.966335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:21.967787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:21.980236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 285/567] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:21.985767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:22.044965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:22.129818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040cea-3017-4af2-aa0e-95e4ee251353 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:22.165250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:22.166187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:22.166605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:22.167015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:22.175125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:22.176733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:22.190252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:22.191422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:22.192598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:22.194837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 283/568] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:22.200775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:22.256621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:22.323898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052037ca-178c-41f6-a69c-ab66cc4a28ad None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:22.361006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:22.362022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:22.362455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:22.362875 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:22.363749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:22.364211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:22.365813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:22.384633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 286/569] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:22.390408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:22.510702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:22.530242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a7ebd-b3d3-4e29-a222-c2ab393d8938 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:22.579310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:22.579849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:22.580125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:22.580398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:22.651998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:22.653453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:22.741476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:22.758849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 284/570] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:31:22.764666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:22.923532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7684-457b-4811-8910-b5283d2a8915 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:22.943161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:22.974039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:22.974681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:22.974955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:22.975222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:22.989025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:22.990498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:23.015842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:23.018181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:23.020317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:23.020317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:23.020317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:23.020317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 287/571] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:23.026711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:23.196268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a683-0fcc-42fa-b510-e7af350f5071 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:23.232575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:23.233181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.233453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.233751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.234439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:23.234742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:23.236095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c25dd-91ba-4a33-9b57-9366ba200b85 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:23.248606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 285/572] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:23.253964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:23.292015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21fe-ce6b-48d7-9bd3-e45eaf6956a2 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.292717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21fe-ce6b-48d7-9bd3-e45eaf6956a2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.292993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee21fe-ce6b-48d7-9bd3-e45eaf6956a2 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.294776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 286/573] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:23.301334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.301638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.301961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.325235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:23.326451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:23.410195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:23.445769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9bdb-d3c9-4334-aead-1b9f0e370d75 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:23.460464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 287/574] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:23.491077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:23.491731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.492007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.492277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.500950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:23.502451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-802cd07e-a555-4516-87bb-39a3dcb12c59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:23.514702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:23.515680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:23.516578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 288/575] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:23.522677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:23.610952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67631-945c-4779-b758-753a91629885 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.611282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67631-945c-4779-b758-753a91629885 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.611497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67631-945c-4779-b758-753a91629885 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.613090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 289/576] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:23.619774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.620076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.620317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.653306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:23.654532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:23.659431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece236-7a54-4b5b-b322-052406dfabb6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:23.689122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:23.708901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:23.710093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:23.711375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:23.713038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:23.714154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:23.715703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:23.718342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:23.740980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 288/577] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:23.754546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:23.784610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 290/578] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:23.821944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:23.850411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:23.944049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd112a-d531-4186-aba6-e57a08acba4a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.026771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.027403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.027645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.032066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.032066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=dd4de9ba564044ab8a8f835faae23ab6) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:24.032066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:24.032066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf491-8cee-49e9-89a1-1714d57d13b4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:24.056756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 289/579] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:23 2022] GET /identity/v3/role_assignments?user.id=dd4de9ba564044ab8a8f835faae23ab6&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:24.062044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ffd74-1545-4f31-8b22-65158be5110f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.118769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc117d-9d70-4f5d-ad27-93867799a010 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.119469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc117d-9d70-4f5d-ad27-93867799a010 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.119973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc117d-9d70-4f5d-ad27-93867799a010 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.121906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 290/580] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:24.125605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc117d-9d70-4f5d-ad27-93867799a010 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.162778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bda48-7769-4772-ab76-416766881b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.163429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda48-7769-4772-ab76-416766881b13 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.163702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda48-7769-4772-ab76-416766881b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.163964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bda48-7769-4772-ab76-416766881b13 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.164554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bda48-7769-4772-ab76-416766881b13 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:24.166233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bda48-7769-4772-ab76-416766881b13 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-073bda48-7769-4772-ab76-416766881b13 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:24.188565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:24.189717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:24.190609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:24.195588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 291/581] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Oct 17 17:31:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:24.197428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.197884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.198163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.236373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:24.237606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:24.267351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:24.342454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc117d-9d70-4f5d-ad27-93867799a010 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.345262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:24.364084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 292/582] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:24.369873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.415458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.416552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.417033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.423141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.463150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:24.468706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:24.469738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:31:24.470623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:24.484654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 291/583] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:24.485671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.630041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70efb6-676e-4e9a-bb0f-349f4d1f6a33 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.665573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.666234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.666509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.666775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.667402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:24.667702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:24.669073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a32df-eb2f-47a6-a4a7-8e891165a220 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:24.674224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 293/584] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:24.675498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b05b-4a5b-423b-9edf-d74ab59554f7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.675780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b05b-4a5b-423b-9edf-d74ab59554f7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.676052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b05b-4a5b-423b-9edf-d74ab59554f7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.677488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 294/585] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:24.679585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b05b-4a5b-423b-9edf-d74ab59554f7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.691955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22337b-e8ab-4be9-a9c4-540d294887d7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.692349 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:24.728720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.729335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.729632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.729910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.730607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:24.730873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:24.732247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59e4d-1a0a-48be-a394-0d8bb403035a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:24.740338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 292/586] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:24.741524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.741834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.742112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.762838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:24.764408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:24.788747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:24.801649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b05b-4a5b-423b-9edf-d74ab59554f7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.840452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.841411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.841954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.842296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 293/587] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:24.842664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.843177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.843760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:24.844276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:24.847120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:24.853224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 295/588] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:24.855167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:24.953381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e3767-b63e-483f-af93-a85aaacb171a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.957317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:24.994458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b258-7722-4e00-b730-21d62e97aef3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:24.996782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:24.998350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:24.998641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:24.998916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] PATH_INFO: `/v3/services/network` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:24.999513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.001191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:25.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:25.013336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:25.014242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 294/589] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:25.015025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.038136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.047649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.049256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.049915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.050467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.065112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.067397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:25.087905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:25.088902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:25.089822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:25.089822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:25.089822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:25.096286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 296/590] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:25.096286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.146873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82bcd-0fec-4e24-abca-7e41896dfd94 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.184886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.185829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.186321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.186879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.187586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] RBAC: Adding query filter params (interface=public, service_id=299cbb43b4114d74825b85d49d3e320b, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.187897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.189511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.202522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 295/591] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/endpoints?service_id=299cbb43b4114d74825b85d49d3e320b&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.202522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.202785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71819a-1919-47d1-a43a-ca8c593f9bea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.228189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.237692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.238299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.238575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.238849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.239476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.239804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.241145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.245646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 297/592] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.246424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.299905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.323572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f5ef2-9194-4ff6-b4bf-94f3c126ba72 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.352723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243b7b-c366-4e08-bd09-8a7d52815eb6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.365136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.365781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.366225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.366501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.367527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.368105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.369629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.383019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 296/593] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.383848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.394557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.395610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.395890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.396159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.409469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:25.414763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:25.415902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:25.416745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 298/594] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:25.417437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.480562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.496870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d37e2-e366-4bd3-99d2-f1a4ea83794a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.532033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c945e-de8a-41b4-b711-c2aaa3e59c45 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.534121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.534740 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.535016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.535285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.535889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.537245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.549614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 297/595] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.549614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.559646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.583539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.584259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.584597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.584961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.585692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] RBAC: Adding query filter params (type=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.586059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.587784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.593703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 299/596] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.594716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.676603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eb313-75fc-4d06-8e2c-de10b25e21d3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.715376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c438-5ebc-4c76-bd61-3cb75ca48974 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.719779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.720605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.720951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.721288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.731829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.733940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.737384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:25.759691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:25.760906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:25.762041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:25.762902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 298/597] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:25.767149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.767296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.767373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.767373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.767373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.767373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.767373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.768534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.784359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 300/598] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.784359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.855189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:25.902010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f70d99-468c-436d-9f99-7369c6e1359a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.918706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff63d-1d6c-41d0-9da8-a6056966e946 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:25.948647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.949320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.949624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.949905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.950619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] RBAC: Adding query filter params (interface=public, service_id=3cca32b855c34fcfa199e936853c83f4, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.950932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.952315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.959281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 299/599] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/endpoints?service_id=3cca32b855c34fcfa199e936853c83f4&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.960180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:25.970098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:25.970736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:25.971061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:25.971339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:25.972162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:25.972474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:25.974047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:25.994084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 301/600] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:25.995256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.031789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.084638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94f01-400a-4ad7-80c8-5600da03c0c1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.104112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8ceb-723a-440a-81d3-43dbd1fce323 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.120466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.128017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.128799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.129002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.129331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.142161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.144586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.147481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.148368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.148835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.149291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.150239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.151814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.158104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 302/601] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:26.159293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:26.160930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:26.161939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:26.163024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:26.163024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:26.163024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:26.163024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 300/602] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:26.178727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.290245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.296407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165189f-b303-4cbe-85ec-b5b1715b3c86 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.338647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.339645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.340115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.340577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.360433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb3e8f-cb2b-4fc0-9280-f43185fab67b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.427324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.427948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.428234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.428503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.429150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:26.429453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.431008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292e8a-b576-41b5-b01f-c9bbeb766877 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.443791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.445437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05cf7-3f68-442f-8a49-c1f4c851e3d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.447398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 301/603] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:26.447398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df2f7-97a0-492c-8858-d20274cab807 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.447398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df2f7-97a0-492c-8858-d20274cab807 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.447705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df2f7-97a0-492c-8858-d20274cab807 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.449652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 302/604] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:26.457080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8df2f7-97a0-492c-8858-d20274cab807 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.517928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.573960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.579988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 303/605] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:31:26.583226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.583793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.584322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.600504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8df2f7-97a0-492c-8858-d20274cab807 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.610254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:26.612655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:26.641175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.642437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.642577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.642902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.650787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.652258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:26.664546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:26.665932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 17:31:26.666888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:26.670773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 303/606] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:26.671637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.694968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 304/607] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:26.696259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.820686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046934-e234-4932-8616-1858882b5cd5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.824599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.832004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fd70a-7ec5-4b6b-9652-21106add3fb3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:26.880187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:26.890897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.892367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.893365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.894346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.896663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:26.898725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:26.900013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:26.900484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:26.901475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:26.904478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.906222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.913820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:26.915744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:26.931210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:26.932460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:26.933333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:26.933333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:26.933333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:26.935576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 304/608] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:26.940901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:26.946592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 305/609] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:26.951981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.096089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de6c-6e07-4cea-bd7c-06b6707f8a3b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.101462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b19c-6041-4cb8-97f9-9945b774cafd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.134926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.135559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.135838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.136110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.138977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.139713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.139995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.140267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.140912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:27.141212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.142625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.155860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 305/610] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:27.156863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.172886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.198004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.213014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.214541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.267406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc82c3-5f3e-44a3-b265-810dd38e7df4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.304569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.305528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.306067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.306486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.307304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.308922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:27.318823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:27.319958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:27.321017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:27.323305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 306/611] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:27.324239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.329836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 306/612] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 17:31:27.330706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.409419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.431462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.434624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518670c-500e-4d00-b034-f64866f4e6ee None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.453081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a4488-7aa4-44ad-a143-87bb4b17e4ba None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.472136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.473013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.473431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.473883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.481138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.482811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.492215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.492844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.493125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.493471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.494141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:27.494447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.495941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:27.497042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:27.498116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:27.499078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:27.501729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 307/613] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:27.502808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.506014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 307/614] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:27.507700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.610818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca0-3354-48b8-9c1f-ca6257eb3045 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.621112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bde022-fe30-4277-ab1f-f261697d1748 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.649386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.650555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.651051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.651525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.658778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.659401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.659732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.659952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.660645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:27.660951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.661836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.663827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.665922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.667815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.679918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 308/615] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:27.680896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:27.683657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:27.684582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:27.685460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:27.685460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:27.685460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:27.688204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 308/616] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:27.688852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.702760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.802814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd679ee-584f-4515-8247-3f9a522c1f1e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.805213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d440-5aa5-486f-9278-a77b4994fa5d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:27.845373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.845918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:27.846549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.846828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.847102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.847325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.847851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=8b098d9fac6d480490d75473398369c9) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:27.848085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.848192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.848651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.849494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:27.849643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.850137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:27.852086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bdc39-876e-4a43-8b0f-a4d8b62af393 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:27.857846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 309/617] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/role_assignments?user.id=8b098d9fac6d480490d75473398369c9&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:27.858779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:27.859465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 309/618] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:27.952165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2046ab-7b76-464a-aff8-f555cf5f84a3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.952363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2046ab-7b76-464a-aff8-f555cf5f84a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.952625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2046ab-7b76-464a-aff8-f555cf5f84a3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.954317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 310/619] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:27.955548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:27.960314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:27.960609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:27.960869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:27.981168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:27.985605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:28.029341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648145e-966f-47aa-a6bc-155b7f76feba None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.096322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.097171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.097460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.097756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.098645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:28.099060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.100704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.124267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 310/620] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:28.131210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:28.131396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 311/621] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:28.246128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f821-8486-488e-8c0d-3cb42f75af97 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.261838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:28.291631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.292278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.292558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.292832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.303038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.304565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:28.317718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:28.318674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:28.319554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 311/622] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:28.326594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:28.330938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:28.465450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:28.478462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f57bc-eb40-4a83-a1c5-244335de59b0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.524805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.525372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.525684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.526005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.526706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:28.527017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.529267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.543254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 312/623] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:28.550924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:28.628221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e508c4-23de-4b41-a616-0c5180ab53a0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.690246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:28.698936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.699595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.699873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.700145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.700735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.702291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1fddc1eb-a15a-4348-b2ba-d8a538f3087e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:28.711788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:28.713010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 17:31:28.713871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:28.717919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 312/624] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:28.719272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e216d-bfe2-4048-84c4-e67f64e00718 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.719553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e216d-bfe2-4048-84c4-e67f64e00718 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.719828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e216d-bfe2-4048-84c4-e67f64e00718 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.721360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 313/625] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:28.722085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e216d-bfe2-4048-84c4-e67f64e00718 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:28.736650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758d6cc-e2bf-485c-a943-6d26996a740c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.773460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:28.775836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.777310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.777674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.777950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.778838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=e33fc4dc7ed74e7bb07e5746aa17e254) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:28.779151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.780810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5342b-6ca2-47d9-828d-f697f5eb923e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.787967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 313/626] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/role_assignments?user.id=e33fc4dc7ed74e7bb07e5746aa17e254&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:28.789220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.789505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.789819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.819894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:28.821368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:28.902004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e216d-bfe2-4048-84c4-e67f64e00718 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:28.957981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 314/627] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:28.983338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:28.983906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:28.984183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:28.984506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:28.985156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:28.985462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:28.986986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:28.994139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 314/628] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:28.999322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:29.085437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:29.134218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eaf60-26c9-4663-b587-fe0482aaa90f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:29.177471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:29.178119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:29.178396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:29.178668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:29.179304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:29.179604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:29.181172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:29.186799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 315/629] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Oct 17 17:31:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:29.194307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:29.325437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5e64-ee81-4bda-bec8-29897219e084 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:29.327295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:29.350159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:29.389200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:29.389844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:29.390124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:29.390396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:29.391075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:29.392444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:29.445004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 315/630] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:29.545943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f512ac-4eb4-4d8a-b2d1-d9ce4ac9891d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:29.577861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:29.602621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:29.603217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:29.603506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:29.603760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] PATH_INFO: `/v3/services/network` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:29.604363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:29.605784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:29.617557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:29.618888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 17:31:29.619737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:29.621013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 316/631] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:29 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:29.627704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:29.769516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d2fd-32dc-4ea6-a453-fef6f67d6d04 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:29.812776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:29.813405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:29.813703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:29.813974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:29.814615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:29.814917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:29.816285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:29.821487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 316/632] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:29.827456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:29.972461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e1e3-f61b-4963-8823-3036e08477ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:30.018297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:30.018923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.019199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.019460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.020108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] RBAC: Adding query filter params (type=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:30.020408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:30.021806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c9e3d-acbe-43ca-9992-91c28b24cf96 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:30.027569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 317/633] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:30.033377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:30.086032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:30.190346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238f952-e46d-45ed-aec1-fda6ea50bbc8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:30.237211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:30.238628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.239137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.239631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.240514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:30.242111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449501b5-cc6c-4efd-bd6a-df2886658e5a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:30.274606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 317/634] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:30.601631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d640d6-1673-4760-aa9a-4b8f89ccf9b7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.602131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d640d6-1673-4760-aa9a-4b8f89ccf9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.602131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d640d6-1673-4760-aa9a-4b8f89ccf9b7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.603800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 318/635] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:30.609639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.609950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.610188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.635378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:30.636583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:30.694375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3558-c4e9-4d35-ba76-0a8309ad64d9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.694707 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3558-c4e9-4d35-ba76-0a8309ad64d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.694925 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3558-c4e9-4d35-ba76-0a8309ad64d9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.696775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 319/636] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:30.702113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:30.702760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:30.703260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:30.722027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 318/637] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:30.730841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:30.732026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:30.781931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:30.808665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 320/638] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:31.023931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.027223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:31.128414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765801b9-acca-4d8d-9e20-49c8b8bbe802 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.135759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.170316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.171408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.171898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.172367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.184883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:31.190331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:31.191259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:31.192097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:31.194914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 319/639] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:31.201277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.243681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a636c8-a8a4-4c19-b0bb-a1239b833a79 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.273185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:31.280599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.281147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.281424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.281779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.282456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:31.283883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:31.304643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 321/640] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:31 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:31:31.327586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484bef6-418e-4138-9272-2301539b7070 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.376822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.377497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.377816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.378084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.378757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:31.379054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:31.380445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3e8a2-aaa3-484b-9032-c33684143ed2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:31.391858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 320/641] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:31.398829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.457335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:31.459431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc70c0-5b13-4a58-947d-c1f27808155c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.461639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc70c0-5b13-4a58-947d-c1f27808155c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.462237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc70c0-5b13-4a58-947d-c1f27808155c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.469824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 321/642] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:31.472564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.473077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.473555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.494609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:31.496014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:31.545524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4afeb-9197-4067-9bb3-86a65a610ce9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.582039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 322/643] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:31.592575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.593547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.594052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.594520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.608601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:31.610904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:31.627990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:31.628968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:31.629971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:31.629971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:31.629971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:31.632083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 322/644] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:31.638737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.694476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:31.749108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480aab-08f6-40a2-beea-41f10e669acd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.784393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.785017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.785293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.785566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.786257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:31.786563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:31.787981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:31.802120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 323/645] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:31.809215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.877177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:31.909458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:31.927695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a90e-bb0f-4988-99a9-486de3edabbf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.968126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:31.968760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.969037 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.969307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.977751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:31.979421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:31.986641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d255e-0e9f-4103-a213-c39ec4e68967 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5c4015a6-4355-4e14-b464-311048d0867f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:31.991402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:31.992345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 323/646] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e918-790f-46c2-a4c0-4d90de0cdc4f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:31.998461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e918-790f-46c2-a4c0-4d90de0cdc4f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:31.999162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e918-790f-46c2-a4c0-4d90de0cdc4f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:31.999162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 324/647] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:31.999162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e918-790f-46c2-a4c0-4d90de0cdc4f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.007381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.029998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.030627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.030904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.031171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.031750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.033106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-378ccb01-ac6c-47ec-8892-ea130931c6b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:32.042693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:32.043714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.044541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 324/648] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:32.046425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.046425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.046425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.065005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:32.066114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:32.112107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e918-790f-46c2-a4c0-4d90de0cdc4f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.137401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 325/649] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:32.138656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.156788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.157411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.157730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.158001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.158754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.159036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.160461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.180001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 325/650] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Oct 17 17:31:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:32.186570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.200600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.265138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38917c4-440b-4a0c-ae49-77fd25182791 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.272786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.302138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.303428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.303877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.304283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.305097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.305825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.306894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f879f-15e0-4bbe-86f1-abead5311130 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.307643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.313300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 326/651] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:32.321305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.347359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.347997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.348316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.348578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.359807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.361253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:32.377884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:32.379019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:32.380054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:32.380054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:32.380054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:32.384118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 326/652] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:32.386080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.435652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b3060-03ae-44e5-87b7-8e0194025e95 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.448541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.473144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.473778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.474400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.474676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.475305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.475907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.477255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.483889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 327/653] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:32.484594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.511114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f71114-e2b2-4747-bb20-a138cb9216ea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.528300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.565979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.566545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.566821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.567081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.567743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.568385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.569461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.588020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 327/654] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:32.589444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.620877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984c36-352f-492b-8906-dc34ae9357fb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.672608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.673252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.673605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.673821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.674410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.675762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:32.689007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:32.690090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:32.690921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:32.695086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 328/655] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:32.696451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.728513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305f6ec-d37f-4a00-a163-181796f782f3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.753648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.777543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.778516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.778806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.779353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.788609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.790148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:32.804940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:32.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:32.806954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 328/656] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:32.812182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.827672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de24aaf-0e83-434c-99db-2899461c107a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.846380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:32.873976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.875165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.875274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.875489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.876126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.876429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.877817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.887691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 329/657] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:32.890154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:32.935296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ecd4d-4102-48d3-9823-43ae65b1b634 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:32.971469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:32.972406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:32.972790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:32.973166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:32.974501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:32.974916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:32.976991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:32.993878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 329/658] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:33.000887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:33.014964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dec18-ca0a-436f-9846-6d7b5bfc4c15 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:33.050207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:33.050849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:33.051175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:33.051448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:33.052082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:33.052386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:33.053862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a679-0ccb-4b87-bef0-84077ffeb916 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:33.059348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 330/659] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:33.059559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:33.132203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2c412-1229-46e7-854f-ab50dcc7ca9a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:33.176026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:33.176708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:33.176987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:33.177266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/8b098d9fac6d480490d75473398369c9/roles/9e33c08a33c94d79833b3a75fe6a97e9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:33.179577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=8b098d9fac6d480490d75473398369c9, role_id=9e33c08a33c94d79833b3a75fe6a97e9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:33.181334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15876bb-9a91-43cd-bcb5-9c0de442b85b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:33.199189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 330/660] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:32 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/8b098d9fac6d480490d75473398369c9/roles/9e33c08a33c94d79833b3a75fe6a97e9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:31:33.685200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241e9c-9e3f-4c35-ada1-bc97ca0f5f9f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:33.685736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241e9c-9e3f-4c35-ada1-bc97ca0f5f9f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:33.685843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241e9c-9e3f-4c35-ada1-bc97ca0f5f9f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:33.687404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 331/661] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:33.692817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:33.693111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:33.693391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:33.714013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:33.715303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:33.786322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 331/662] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:33 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:34.056156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241e9c-9e3f-4c35-ada1-bc97ca0f5f9f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:34.087101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:34.173553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241e9c-9e3f-4c35-ada1-bc97ca0f5f9f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:34.210057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:34.210696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.210972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.211245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.212082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:34.214407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:34.226485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:34.227716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:34.229166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 332/663] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Oct 17 17:31:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:34.233992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:34.262651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:34.339530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bededd76-8a6e-4238-a90f-5b942a0b1a2c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:34.375454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:34.376426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.376924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.377381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.378265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:34.378760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:34.380379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:34.385894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 332/664] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:34.393668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:34.495468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:34.506430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3445-c5ba-4a7a-bb8e-e2fe9b661d35 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:34.542394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:34.543015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.543355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.543636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.544508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:34.544814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:34.546291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b4ca-debf-419a-bd85-039a50b4543f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:34.551776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 333/665] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:34.557972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:34.660838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:34.670621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86075a7-0d52-4299-a570-abe59eb6c2d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:34.705677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:34.706295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.706570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.706842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.707539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] RBAC: Adding query filter params (interface=public, service_id=b3860600499a4188b7a8eadc942712ad, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:34.707846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:34.709266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c4153-9b5a-4828-b957-f460e9257f17 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:34.716404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ec8-3905-468a-87fc-987f7ed46f98 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.716903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ec8-3905-468a-87fc-987f7ed46f98 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.716982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ec8-3905-468a-87fc-987f7ed46f98 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.718110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 333/666] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:34 2022] GET /identity/v3/endpoints?service_id=b3860600499a4188b7a8eadc942712ad&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:34.718515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 334/667] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:34.723728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.724013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.724283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.726487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494ec8-3905-468a-87fc-987f7ed46f98 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:34.746228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:34.747404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:34.825702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 334/668] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:34 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:34.855389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494ec8-3905-468a-87fc-987f7ed46f98 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:34.892380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:34.893353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:34.893871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:34.894380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:34.895181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:34.896816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a121-ac90-41a7-b6d5-356feba5a4bb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:34.903995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 335/669] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:34 2022] GET /identity/v3/services => generated 1029 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:31:35.084629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:35.179652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:35.200282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d4f8-5659-4a80-8046-60a5ea3db977 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:35.244303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:35.245288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.245746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.246161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.247008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:35.248566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1c436-b463-4d72-afa7-bf72235c8ede None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:35.266489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 335/670] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:35 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:35.334165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0be1-798b-4052-861d-93380051eeaa None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.334700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0be1-798b-4052-861d-93380051eeaa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.335029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0be1-798b-4052-861d-93380051eeaa None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.338001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 336/671] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:35.343428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c7fb-e802-42ba-8c39-aea4e51ff77d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.343975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c7fb-e802-42ba-8c39-aea4e51ff77d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.344446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c7fb-e802-42ba-8c39-aea4e51ff77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.365516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cbc7c7fb-e802-42ba-8c39-aea4e51ff77d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:35.367202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cbc7c7fb-e802-42ba-8c39-aea4e51ff77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:35.456103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 336/672] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:35 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:35.594144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b792-3e1d-413b-8f6e-be1e9bb03292 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.594352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b792-3e1d-413b-8f6e-be1e9bb03292 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.594599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b792-3e1d-413b-8f6e-be1e9bb03292 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.596202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 337/673] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:35.601497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.601816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.602097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.622885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:35.624094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:35.697829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 337/674] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:35 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:35.747268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4b792-3e1d-413b-8f6e-be1e9bb03292 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:35.767211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:35.860629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4b792-3e1d-413b-8f6e-be1e9bb03292 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:35.898526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:35.899145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:35.899458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:35.899840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:35.900787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:35.902241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:35.919841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 338/675] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:35 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:35.992299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:35.995291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:36.119630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5c3f-3e5d-4c3b-96f2-ab7bb774191b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:36.163296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:36.163938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:36.164216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:36.164483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:36.175928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:36.180902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:36.182012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:36.183252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 338/676] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:31:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:36.188430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:36.273340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:36.297136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f0a0-d5bf-4aea-a349-21cb0d5a915d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:36.332084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:36.332697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:36.332974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:36.333242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:36.333941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:36.334240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:36.335605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:36.344387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 339/677] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Oct 17 17:31:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:36.350155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:36.412747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:36.459704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe8c2-7284-4aef-914d-8c65c4ea9e12 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:36.497468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:36.498160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:36.498439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:36.498708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:36.510112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:36.511580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:36.527011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:36.527971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:36.528853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:36.528853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:36.528853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:36.528853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 339/678] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:36.533939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:36.650592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9a0a2-2e43-43b8-9f88-6d3b5541f682 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:36.686659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:36.687633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:36.688126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:36.688605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:36.689450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:36.689977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:36.691543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:36.704797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 340/679] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:36.705137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:36.710086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:36.819644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237bd57-8776-406a-90fd-94ae67a5bea0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:36.831254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:36.857672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:36.858722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:36.859199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:36.859666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:36.867769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:36.869541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:36.881897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:36.882877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 17:31:36.883905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:36.886526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 340/680] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:31:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:36.894660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.002685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939e76-87f4-4a3b-8423-95e196052dd8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.039193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.040138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.040562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.040979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.041964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:37.042448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.044048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce38d4-adc1-4e8d-aac1-3e230204c012 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.062968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 341/681] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Oct 17 17:31:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:37.074958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.188014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7732-e119-4eb5-847a-716c82c6611d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.215002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224845e2-3a59-4ce9-8881-d9ca20121eb2 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.215337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224845e2-3a59-4ce9-8881-d9ca20121eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.215617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224845e2-3a59-4ce9-8881-d9ca20121eb2 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.217523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 342/682] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:37.223388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.223679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.223953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.228440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.229444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.229970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.230491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.242645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:37.246354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:37.277766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.311372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.314878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.316351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e231e-045d-4de5-bd60-e0d1390a983a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.335848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 343/683] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:37.428189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 341/684] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:31:37.434257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.546879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3d97-2896-4255-921f-11dfd513cbaf None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.583493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.584127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.584459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.584736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.589628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ec8-a314-4129-affa-60807bb31c65 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.590045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ec8-a314-4129-affa-60807bb31c65 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.590348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f8ec8-a314-4129-affa-60807bb31c65 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.595651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 342/685] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:37.595772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.597167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.597306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.597468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.597757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:37.614410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:37.615613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:37.616654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:37.616654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:37.616654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:37.616654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 344/686] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:37.616654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.621621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:37.621621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:37.667627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.695654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.704286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 343/687] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:37.705130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.745659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9d375-cc29-46d1-80eb-51e970c19c34 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.782931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.783710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.784087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.784456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.785506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.786663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:37.796116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:37.797359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 17:31:37.798503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:37.805238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 345/688] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:37.806147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.837104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898042fe-3b1e-4587-9ebc-61715d53caf0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.877318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.878000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.878276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.878544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.879187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:37.879554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.880841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.893430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 344/689] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:37.898893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:37.930099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f21a9-c284-4fcb-9d95-e9fd4e928ce3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:37.934377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.962547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:37.980751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:37.981363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:37.981670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:37.981942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:37.982575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:37.982876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:37.984749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:37.990253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 346/690] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:37.991325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.012514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddd55-86ad-4c9c-95eb-db39fbdb689a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.046971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.047658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.047859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.048119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.055053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.056611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:38.068032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:38.068931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:38.069851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 345/691] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:38.070321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.103515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757344f-d03e-4c06-b818-28be20f846b2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.142341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.142972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.143246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.143512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.144092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.145454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:38.156660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:38.157760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:38.158593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:38.159315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 347/692] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:38.159909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.185322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349232-efe4-4ce6-aef8-ace4ed16bce3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.199048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.209115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.224712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.225442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.225768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.226041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.226674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.226974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.228400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.233563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 346/693] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.234298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.277782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc514d9-629c-4807-b2a1-32dba2708045 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.314108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.314628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.314898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.315172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.315864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.316168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.317605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.329549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 348/694] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.330424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.341995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2b6d-6caa-4e58-ba9c-e646bbb3a741 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.377812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.378420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.378726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.378965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.379594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.379898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.381264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e383494-6e23-4415-8bc2-af3342cf6eee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.386126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 347/695] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.387441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06444346-2a59-442d-9dc3-3ebfe6bee812 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.387783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06444346-2a59-442d-9dc3-3ebfe6bee812 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.388119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06444346-2a59-442d-9dc3-3ebfe6bee812 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.389359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 348/696] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:38.390073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06444346-2a59-442d-9dc3-3ebfe6bee812 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.428166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.438063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ba269-5339-4077-bcab-d7290d0ce078 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.445247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.475840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.476449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.476729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.476992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.477891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.479239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.500148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 349/697] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:38.500961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.517841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06444346-2a59-442d-9dc3-3ebfe6bee812 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.561615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.562243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.562515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.562783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.563557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] RBAC: Adding query filter params (role.id=9e33c08a33c94d79833b3a75fe6a97e9, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=8b098d9fac6d480490d75473398369c9) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.563891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.565427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7792a-4096-436c-a741-e8f3e5fb3823 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.572066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 349/698] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/role_assignments?user.id=8b098d9fac6d480490d75473398369c9&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=9e33c08a33c94d79833b3a75fe6a97e9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.579278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.579649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.579835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.601809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:38.603706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:38.635820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256988-019d-4ed3-bd57-657aca275657 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.680508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.682140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.682746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.683223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.684104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.684652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.686627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.693606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 350/699] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:38.699200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 350/700] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.705486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.752828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.823159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a6743-5d7b-4462-8d9e-012b3c1daefb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:38.864283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:38.864901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:38.865177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:38.865501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:38.866253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] RBAC: Adding query filter params (interface=public, service_id=10ba10cc16854e66ace0ae741d41e13d, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:38.866558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:38.867970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:38.873891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 351/701] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/endpoints?service_id=10ba10cc16854e66ace0ae741d41e13d&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:38.879548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.895579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:38.983179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:38.988428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd40c-4566-40ed-aabf-4e7835a4ceb6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.023817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.024598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.025070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.025358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.026025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.027656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.033835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 351/702] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:31:39.123855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96550b-abec-4a47-b8b0-1c1df6853877 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.125990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:39.165351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.166031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.166306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.166573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.167161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.168767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:39.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:39.179888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:39.180793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 352/703] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:39.186716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:39.279568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:39.303679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b023-f407-4e33-8d7f-c8f274eb2c1b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.339674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.340293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.340570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.340843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.341483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:39.341816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.343174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.348684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 352/704] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:39.354544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:39.467106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba00ee-1548-4b8b-a5ff-8cf1368758f2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.505517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.506166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.506447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.506720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.507355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:39.507660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.509098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.514724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 353/705] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:39.520747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:39.629883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fafda3-7ed1-487f-8498-5b9eba45e80d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.664894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.665505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.665838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.666269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.666975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] RBAC: Adding query filter params (interface=public, service_id=feec908a42324429b85b2c0f56750202, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:39.667285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.668645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1f96-68fd-4cb6-a573-deabc5296324 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.674162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 353/706] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:39 2022] GET /identity/v3/endpoints?service_id=feec908a42324429b85b2c0f56750202&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:39.679982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:39.711827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:39.787769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca43b-5879-4555-aa4c-93a8bee4c358 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:39.823609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:39.824605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:39.825135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:39.825640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:39.826586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:39.828211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba8830-da87-4255-af96-8fb0f1775dd4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:39.835456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 354/707] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:39 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:31:40.755588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad610e3-2c5f-41f7-92af-77154b59a88b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:40.756103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad610e3-2c5f-41f7-92af-77154b59a88b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:40.756103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad610e3-2c5f-41f7-92af-77154b59a88b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:40.757668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 354/708] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:40.763663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c378-3c0e-4cab-b2e0-2fc18e6fd952 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:40.764116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c378-3c0e-4cab-b2e0-2fc18e6fd952 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:40.764216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c378-3c0e-4cab-b2e0-2fc18e6fd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:40.782501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a574c378-3c0e-4cab-b2e0-2fc18e6fd952 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:40.783667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a574c378-3c0e-4cab-b2e0-2fc18e6fd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:40.860241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 355/709] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:40.935603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f67a2-f1b6-4c13-a91e-26be80a281c3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:40.936301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f67a2-f1b6-4c13-a91e-26be80a281c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:40.936805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f67a2-f1b6-4c13-a91e-26be80a281c3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:40.938831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 355/710] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:40.944537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:40.945042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:40.945598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:40.967633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:40.968846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:40.987042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:41.038154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 356/711] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:41.127312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f67a2-f1b6-4c13-a91e-26be80a281c3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.133207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:41.242946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f67a2-f1b6-4c13-a91e-26be80a281c3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.280174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.280826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.281099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.281371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.282000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.283423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:41.292493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:41.293485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.294799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 356/712] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:41.301980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.309717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.378110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:41.415554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e515b7-51d8-404f-ae3b-fb79fcda5760 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.419055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6eca-1177-4140-b7ae-c0a67ccb0fcb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.452052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.452668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.452946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.453216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] PATH_INFO: `/v3/services/image` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.454196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.455181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a852657f-093b-478e-96c4-90540fc7e0cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:41.465087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:41.466227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:41.472172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 357/713] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:41.472966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64f97-00ce-4893-b147-a0ed17638bbd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.472966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64f97-00ce-4893-b147-a0ed17638bbd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.472966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64f97-00ce-4893-b147-a0ed17638bbd None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.472966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 358/714] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:41.474246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b64f97-00ce-4893-b147-a0ed17638bbd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.475896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.476587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.476939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.477282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.478563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:41.478937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.480399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee06e-fd01-4b68-a24c-3d1e5247eba0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.485671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 357/715] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:41.491143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.491429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.492150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.512510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:41.513814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:41.527799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:41.589775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 358/716] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:41.589775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.594776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b64f97-00ce-4893-b147-a0ed17638bbd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.625392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:41.632305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.633469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.633899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.634329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.635194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] RBAC: Adding query filter params (name=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:41.635615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.637242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.648392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 359/717] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:41.649428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.699890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb418-30b8-45f2-a764-846c1329d4b2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.737176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.738289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.738736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.739267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.740061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:41.740530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.742197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.753230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 359/718] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:41.783410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c3fb5-6e8e-4882-bdfb-54ccd810d7cd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:41.821973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:41.822626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:41.822898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:41.823164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:41.823804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] RBAC: Adding query filter params (type=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:41.824103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:41.825460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e2c71-7d32-4f3b-805c-922a2b2b785b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:41.831084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 360/719] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:41.885870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:41.904831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.019850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01b34-3556-4535-b3c5-cd4348edd01f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.058327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.058971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.059256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.059527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.060120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.061496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:42.070702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:42.071898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:42.073469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 360/720] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:42.077259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a715e-54e8-4644-a12e-cac0db59a22e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.077546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a715e-54e8-4644-a12e-cac0db59a22e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.077926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a715e-54e8-4644-a12e-cac0db59a22e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.078373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.079479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 361/721] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:42.084764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.085313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.085829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.105223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:42.106823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:42.172306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.174671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.197612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 362/722] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:42.197810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824683a4-bd01-4b5b-9997-7359b9427e0b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.237047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.237693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.238365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.238642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.239274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:42.239573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.240939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.246646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 361/723] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:42.252662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.360238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217b68-b9a3-4f0f-96ba-5891f4d0b29a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.396666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.397275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.397547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.397843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.398476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:42.398774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.400422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.406061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 363/724] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:42.411679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.472786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.532451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.535847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3f25a-6a2e-49a1-a76e-aa11613766a6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.580293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.581296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.581628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.581870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.582817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.584185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.584850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092d90-64e7-46d4-b342-58e4dc721386 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.599530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.616350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 362/725] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:42.642577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.643499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.644122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.644548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.645313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.647082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:42.657817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:42.659094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 17:31:42.660143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:42.662889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 364/726] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:42.672555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.791055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3c639-fe5f-4abf-9e45-d8dde8d5ccbd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.830251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.830888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.831160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.831427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.832071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:42.832369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.834543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.840502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 363/727] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:42.845451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:42.949854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a035ff-98eb-4a63-92b1-2ea0836092a5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:42.963862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:42.985498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:42.986150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:42.986423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:42.986690 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:42.987329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:42.987626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:42.989012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cd48e-faaf-49db-9a35-b6cdc5765337 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:42.994468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 365/728] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Oct 17 17:31:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:43.000397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:43.064321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:43.111027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f6096-b27e-44d4-8f64-4523b28fb5d3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:43.148968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:43.150309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:43.150797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:43.151286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:43.152166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:43.153765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62afd0-1932-4904-b6d7-2bbb8f4ee130 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:43.178217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 364/729] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:44.076254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397f8-16b0-48da-9d11-4027d05f991c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.076859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397f8-16b0-48da-9d11-4027d05f991c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.076859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9397f8-16b0-48da-9d11-4027d05f991c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.078577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 366/730] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:44.084835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737eead-861d-4eb3-9872-2fa1827713df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.085377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737eead-861d-4eb3-9872-2fa1827713df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.085377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737eead-861d-4eb3-9872-2fa1827713df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.104764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3737eead-861d-4eb3-9872-2fa1827713df None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:44.106336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3737eead-861d-4eb3-9872-2fa1827713df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:44.184164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba547bd-bbea-43dc-ae7b-a08abdd8a282 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.184619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba547bd-bbea-43dc-ae7b-a08abdd8a282 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.184748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba547bd-bbea-43dc-ae7b-a08abdd8a282 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.185148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 365/731] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:44.189606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 367/732] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:44.191621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.191920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.192205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.210374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:44.211581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:44.247638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:44.281567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 366/733] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:44.466479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba547bd-bbea-43dc-ae7b-a08abdd8a282 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:44.552580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:44.584646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba547bd-bbea-43dc-ae7b-a08abdd8a282 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:44.620791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:44.621407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.621717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.621991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.622651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:44.624027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa53429-bdc7-48d6-9099-677f1eb2a9da None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:44.642908 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 368/734] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:44 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:44.667713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c84d3-1b81-44e8-8636-b0f79de6a996 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:44.718255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:44.718952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.719240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.719513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.720175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:44.721785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c21d-6cc4-4f65-a0b6-ca2c9e70f66b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:44.743326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 367/735] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:44 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:44.936620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda6af-7751-4f48-a38b-91cf3c1ca651 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.936968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda6af-7751-4f48-a38b-91cf3c1ca651 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.937166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecda6af-7751-4f48-a38b-91cf3c1ca651 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.938627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 369/736] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:44.944309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9f7-9699-4611-a651-742ddfddc658 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:44.944595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9f7-9699-4611-a651-742ddfddc658 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:44.944864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9f7-9699-4611-a651-742ddfddc658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:44.964136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-873ff9f7-9699-4611-a651-742ddfddc658 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:44.965314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-873ff9f7-9699-4611-a651-742ddfddc658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:44.992129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:45.052128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 368/737] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:44 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:45.323672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecda6af-7751-4f48-a38b-91cf3c1ca651 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:45.369737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:45.420048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc1f8-bd10-4ce5-9b7d-32c7230e3bca None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.420571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc1f8-bd10-4ce5-9b7d-32c7230e3bca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.420571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc1f8-bd10-4ce5-9b7d-32c7230e3bca None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.423297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 369/738] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:45.427398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.427681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.427953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.445626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecda6af-7751-4f48-a38b-91cf3c1ca651 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:45.458344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:45.459781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:45.492827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:45.493482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.493780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.494052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.494915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:45.496274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:45.507465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:45.508612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:45.510242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 370/739] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:45.516000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:45.549737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 370/740] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:45 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:45.630967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e89e0-a546-4f4c-82b3-d15dea7e2a46 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:45.632490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:45.666696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687249-94af-4029-987b-db18f370b43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:45.667304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687249-94af-4029-987b-db18f370b43f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.667576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687249-94af-4029-987b-db18f370b43f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.667842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687249-94af-4029-987b-db18f370b43f None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.668465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45687249-94af-4029-987b-db18f370b43f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:45.668760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45687249-94af-4029-987b-db18f370b43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:45.670134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45687249-94af-4029-987b-db18f370b43f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:45.675445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 371/741] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:45.681791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:45.776376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:45.795439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55aae0-c2b1-4b19-801b-43cf3e9f6760 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:45.829358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687249-94af-4029-987b-db18f370b43f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:45.831975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:45.832994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.833977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.837923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.839189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:45.839729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:45.841697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:45.849332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 371/742] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:45.855747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:45.935150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687249-94af-4029-987b-db18f370b43f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:45.959879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4da2b-1aaa-4fef-b050-114b1c7cefb5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:45.970838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:45.971453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:45.971736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:45.972001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:45.972784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:45.974320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:45.977205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING keystone.server.flask.common [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 17 17:31:45.996828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:45.996828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:31:45.996828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [parameters: {'id': '836fea03ce154897a454e9c190af636d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 17:31:45.996828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 17:31:45.998365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:45.999239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.000010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.000488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.001426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] RBAC: Adding query filter params (interface=admin, service_id=10ba10cc16854e66ace0ae741d41e13d, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:46.001950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:46.003562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 836fea03ce154897a454e9c190af636d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 836fea03ce154897a454e9c190af636d. Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:46.004977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 17:31:46.005867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Oct 17 17:31:46.006818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 17:31:46.007737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 17:31:46.008762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:46.009550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'id': '836fea03ce154897a454e9c190af636d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:46.010449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:46.011231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 836fea03ce154897a454e9c190af636d. Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.012193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 372/743] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Oct 17 17:31:45 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:46.014140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:46.020049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 372/744] 10.222.0.62 () {56 vars in 1249 bytes} [Mon Oct 17 17:31:45 2022] GET /identity/v3/endpoints?service_id=10ba10cc16854e66ace0ae741d41e13d&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:46.026832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:46.043704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:46.054084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:46.130896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e30a-3c28-424b-97cd-e49e741dbae2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:46.140698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cabece-434c-4f08-aebe-39177296c84b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:46.168328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:46.169160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.169354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.169635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.177393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:46.177632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:46.178482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.178947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.179185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:46.179601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.180486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:46.182104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780a7b2-6a88-4ad3-927a-210a8e91de13 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:46.196362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:46.197259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:46.198182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 373/746] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:46.198659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 373/746] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:46 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:31:46.199039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:46.292059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:46.313105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5733-29c5-4e10-9327-2870cf29053e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:46.351296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:46.351985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.352267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.352506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.353183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:46.353483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:46.355024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7559aa2-b38a-4243-8b88-f507a66057c4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:46.378809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 374/747] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:46.939769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5818c-a914-44e6-b986-74773a09fbdf None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.940786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5818c-a914-44e6-b986-74773a09fbdf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.941284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5818c-a914-44e6-b986-74773a09fbdf None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.943152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 374/748] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:46.949212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:46.949781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:46.950275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:46.971134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:46.973230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:47.011866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3fd9-40ed-4212-b26c-945f983605f8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.012190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3fd9-40ed-4212-b26c-945f983605f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.012404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3fd9-40ed-4212-b26c-945f983605f8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.014032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 375/749] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:47.020506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.021029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.021505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.039972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:47.041614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:47.057075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 375/750] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:46 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:47.122239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 376/751] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:47.341716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.393748 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.404389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.424048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.472138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545593f8-6b65-4545-9c63-52e9c18384c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.510067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.511192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.511698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.512175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.512976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.514692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:47.524802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:47.525961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:47.526796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:47.529556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 376/752] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:47.537637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.537808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38575f0-c3f6-4e28-a9a6-7423205ef296 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.579105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.579535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.579830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.580099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] PATH_INFO: `/v3/services/image` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.580698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.582307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:47.592105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:47.593420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:47.594344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:47.598318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 377/753] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:47.599299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.648084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64d1b-4754-4eb4-b057-8aa55cd5a951 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.682388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.683266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.683683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.684090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.684851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:47.685306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.686862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.688989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.697652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 377/754] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:47.698536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.701950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.714156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fa07f-76d6-40c4-9618-53568faed717 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.752611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.753473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.754227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.754646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.755451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] RBAC: Adding query filter params (name=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:47.755899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.757668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.763670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 378/755] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:47.769545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.805402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403f51-3a31-4041-9ec2-56f7928e20eb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.839557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.840168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.840440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.840703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.841339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:47.841927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.843071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.848287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 378/756] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:47.854239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.879575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae2af3-6dbd-4115-86bc-7c33e92d5b54 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.917057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.918894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.919682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.920389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.920811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.922722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:47.923212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:47.924879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:47.929223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:47.935538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 379/757] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:47.941152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:47.959420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35b915-7510-41a3-b336-0c0b15dae423 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:47.996135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:47.996925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:47.997330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:47.997739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:47.998602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] RBAC: Adding query filter params (interface=public, service_id=fac93159f8d54ddfaec74535f7fbe8a9, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:47.998932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:48.001039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:48.011945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 379/758] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/endpoints?service_id=fac93159f8d54ddfaec74535f7fbe8a9&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:48.012906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:48.060514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386b23-5b34-4d53-b7be-b661001234a8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:48.096390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:48.097389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.097934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.098415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.099468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] RBAC: Adding query filter params (interface=public, service_id=63fd835a05a0492e93fc9b2512fccdcf, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:48.099970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:48.101695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:48.112427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 380/759] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:31:47 2022] GET /identity/v3/endpoints?service_id=63fd835a05a0492e93fc9b2512fccdcf&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:48.113623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:48.135310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0831b-77f3-4216-9f35-9f79908a305b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:48.164554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:48.174765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:48.175546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.175823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.176089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.176758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:48.178781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e3a0f-9828-446d-9de5-855ef0b436c4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:48.182673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:48.193706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 380/760] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:48 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:31:48.231159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f536d-b2db-4321-992f-a009da704d24 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:48.270946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:48.271984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.272451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.272927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.273804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:48.275534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b68932-e6f0-415e-bc80-1656cfca4c44 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:48.283551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 381/761] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:31:48 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:31:48.432083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbe0e-eb8f-42ad-8587-c3bb8af2e03a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.433086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbe0e-eb8f-42ad-8587-c3bb8af2e03a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.433374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fbe0e-eb8f-42ad-8587-c3bb8af2e03a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.435216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 381/762] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:48.444394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10064952-7d98-446b-9674-a4472e95d07f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.445002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10064952-7d98-446b-9674-a4472e95d07f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.445468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10064952-7d98-446b-9674-a4472e95d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.468684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-10064952-7d98-446b-9674-a4472e95d07f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:48.470051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-10064952-7d98-446b-9674-a4472e95d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:48.544426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 382/763] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:48.685730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17668e-4138-40ab-a27f-a8b12119c766 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.685944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17668e-4138-40ab-a27f-a8b12119c766 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.686168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17668e-4138-40ab-a27f-a8b12119c766 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.687811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 382/764] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:48.693233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.693522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.693839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.712993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:48.714231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:48.773623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:48.792750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 383/765] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:48.827502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17668e-4138-40ab-a27f-a8b12119c766 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:48.935033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17668e-4138-40ab-a27f-a8b12119c766 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:48.971154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:48.971794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:48.972138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:48.972444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:48.973081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:48.974502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:48.984371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:48.985348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:48.986199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 383/766] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Oct 17 17:31:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:48.991743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.068990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.100576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dd90a-171b-4426-9cf4-b98bcbef9739 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.129656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:49.143220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.145304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.145761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.146206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.146996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:49.147463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.149052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.159016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 384/767] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:49.164847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.184673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d650a4-21c2-42ec-b269-f12c9bf6201b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.227190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.228111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.228848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.229798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.230923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.232876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:49.233500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.255608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 17:31:49.255608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 17:31:49.255608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [parameters: {'user_id': 'e25747c812924babb417171eef6c733e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 17:31:49.255608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:49.266482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:49.267397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 17:31:49.268381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 17:31:49.269305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:49.271251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:49.272080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e25747c812924babb417171eef6c733e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:49.275181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 17 17:31:49.277087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.279266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 384/768] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Oct 17 17:31:49 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:49.280235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.301296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee061ea7-7025-4566-8063-b7cd3c654b0c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.340001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.341062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.341607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.342079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.343054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:49.343654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.345417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.352246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 385/769] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Oct 17 17:31:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:49.361630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.399065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532de6-01bc-49d6-a9ca-204bb3904bad None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.422231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:49.448067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.448701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.448969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.449235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.457774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.459404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:49.473512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:49.474525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:49.475527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 385/770] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:49.480840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:49.516144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6572a-9c3f-4a4e-af48-501a428c1fa0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.554099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:49.562672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.563592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.563998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.564362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.565617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.568042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e615c9-ee2d-423d-b004-8354a4b9fc85 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.592637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad889a2-8314-4594-93d6-6a33def6cf38 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:49.597707 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 386/771] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:49.650127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:49.651468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:49.652004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:49.652463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:49.653385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:49.653902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:49.655625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b576f9-bab6-4b16-b22e-193c212bd9e8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:49.705748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 386/772] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Oct 17 17:31:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:50.517022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58b-099f-4f3c-8b70-212017de657d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:50.517569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58b-099f-4f3c-8b70-212017de657d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:50.517569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58b-099f-4f3c-8b70-212017de657d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:50.519014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 387/773] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:50.524742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:50.525207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:50.525285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:50.545457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:50.547038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:50.577424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:50.594974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313867-6653-457e-8519-07573c2f45f6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:50.595779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313867-6653-457e-8519-07573c2f45f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:50.596059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313867-6653-457e-8519-07573c2f45f6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:50.597844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 388/774] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:50.603050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:50.603319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:50.603617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:50.622160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:50.623340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:50.627199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 387/775] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:50.697498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 389/776] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:50.891137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:50.966200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.003784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b8d1-76cb-4d38-9695-9c73a755ae57 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.040394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.041020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.041292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.041558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.042157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.043534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:51.053054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:51.054064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:51.054886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 388/777] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:51.060135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.079956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adddb7e-c9bb-4b8e-9584-4b0d73c385d8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.083470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:51.089455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:51.121782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.122695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.122976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.123254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] PATH_INFO: `/v3/services/image` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.123916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.125655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:51.134900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:51.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:51.136692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 390/778] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Oct 17 17:31:50 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:51.142001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.172077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b97ce-a3c5-4165-a06a-1c97711631b0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.207927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.208545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.208828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.209098 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.209761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:51.210063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.211567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.216956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 389/779] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:51.222569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.265014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa163-18d9-448f-8631-ff8a30622165 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.300146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.300753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.301032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.301293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.301952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] RBAC: Adding query filter params (name=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:51.302252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.303664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.308577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 391/780] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:51.314296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.319567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:51.330255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534a69-87ea-42ea-ae39-d4d7a71905cc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.347046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:51.370667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.371370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.371640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.371825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.372458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:51.372861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.374709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.380222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 390/781] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Oct 17 17:31:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:51.386455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.424861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f3b5b-8a72-417a-b7a2-c921fbf81399 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.468852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.469508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.469778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.470048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.470677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] RBAC: Adding query filter params (type=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:51.470976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.472372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.477161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 392/782] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:51.482698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:51.501613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ac2fc-929c-4f84-b1b1-e7e0e9dad183 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.535838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.536461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.536873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.537119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.537807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.539163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759e8e5-f60b-450e-84db-5477421e0d89 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.573617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 391/783] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:31:51.588236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:51.596292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57d9b-12b1-4738-8962-8cfbbea4387a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:51.646009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:51.646628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.646904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.647170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.647838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:51.649292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7118c-8d64-4c8e-b83a-c0c5324271f3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:51.672491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 393/784] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:31:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:31:51.829693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8124ac2-0b12-49e6-b0b2-c1dc22e70340 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.830040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8124ac2-0b12-49e6-b0b2-c1dc22e70340 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.830226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8124ac2-0b12-49e6-b0b2-c1dc22e70340 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.831737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 392/785] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:51.837664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:51.837950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:51.838224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:51.858059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:51.859292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:51.937938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 394/786] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:52.204161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8124ac2-0b12-49e6-b0b2-c1dc22e70340 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:52.217824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:52.310272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8124ac2-0b12-49e6-b0b2-c1dc22e70340 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:52.343917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:52.344565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:52.344834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:52.345097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:52.346247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:52.347665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838632ad-fa1e-4d50-993f-6421b551f059 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:52.349406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 393/787] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:52.355405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:52.440522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:52.472601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ef75-7659-46d4-ae62-223134e935ab None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:52.509201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037787d6-776b-45d4-8996-bb217692347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:52.509839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037787d6-776b-45d4-8996-bb217692347b None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:52.510117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037787d6-776b-45d4-8996-bb217692347b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:52.510387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037787d6-776b-45d4-8996-bb217692347b None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:52.511040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037787d6-776b-45d4-8996-bb217692347b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:52.512489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037787d6-776b-45d4-8996-bb217692347b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:52.541292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 395/788] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:31:52 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:31:53.826558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a30db-4d0f-42a0-be44-1731adcfb31c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:53.827205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a30db-4d0f-42a0-be44-1731adcfb31c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:53.827205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a30db-4d0f-42a0-be44-1731adcfb31c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:53.828521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 394/789] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:53.833688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:53.834161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:53.834244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:53.853736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:53.854934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:53.902343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3de317-2691-4288-98e2-0c4aa4db5524 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:53.902925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3de317-2691-4288-98e2-0c4aa4db5524 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:53.903156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3de317-2691-4288-98e2-0c4aa4db5524 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:53.904508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 395/790] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:31:53.909799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147710-32da-4ead-9958-12346b083fed None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:53.910081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147710-32da-4ead-9958-12346b083fed None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:53.910348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147710-32da-4ead-9958-12346b083fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:53.928504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 396/791] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:53.928910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-02147710-32da-4ead-9958-12346b083fed None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:53.930160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-02147710-32da-4ead-9958-12346b083fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:54.004936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 396/792] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:54.194825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.264949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147710-32da-4ead-9958-12346b083fed None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.276640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.376318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.376574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147710-32da-4ead-9958-12346b083fed None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.414511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.415551 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.415705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.415962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.416794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:54.418522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:54.427559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:54.427559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:31:54.427559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [parameters: {'id': '52b949e2fdab40aeb8eb989dfadac992', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 17:31:54.427559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 17:31:54.428331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219166-034c-4db5-9efb-b8c9902e7fea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:54.434976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 17:31:54.435857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 17:31:54.436847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 17:31:54.438780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 17:31:54.439880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 17:31:54.440701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'id': '52b949e2fdab40aeb8eb989dfadac992', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 17:31:54.443719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:54.446531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 397/793] 10.222.0.62 () {60 vars in 1137 bytes} [Mon Oct 17 17:31:54 2022] POST /identity/v3/domains => generated 190 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:54.449450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.474140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.474783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.475054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.475321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.487046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:54.492379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:54.493609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:54.494508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 397/794] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:54.500872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.527690 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.563229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330735-eb5c-484a-bfd4-903062892137 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.603932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.604567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.604842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.605106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.612469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bfd9-f5ae-46af-a4ee-94efdb9fae82 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.616169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:54.617756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:54.630841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:54.634976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:54.635932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:54.636801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:54.636801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:54.636801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:54.641107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 398/795] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:54.642004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.654554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.655306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.655684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.656018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.656716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:54.657181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:54.658676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:54.669015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 398/796] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:54.675792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.765766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162edda-6096-4dbb-b24c-6005d0aa9137 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.788863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717bf2-e448-4f56-9a35-95ceae5d808f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:54.790691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.803361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.803972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.804275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.804547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.805353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:54.806023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:54.807424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da5ab-b9b2-4e87-9367-a9c1647eed3d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:54.824036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 399/797] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:54.825310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ec78-5e69-46cf-aebd-c7a0977fec98 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.825613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ec78-5e69-46cf-aebd-c7a0977fec98 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.825889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5ec78-5e69-46cf-aebd-c7a0977fec98 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.827140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 400/798] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:54.833138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.833417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.833726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.834719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:54.835412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:54.835691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:54.835960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:54.850135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:54.851662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:54.859428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:54.860673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:54.873903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:54.875254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:54.876511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:54.876511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:54.876511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:54.876511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 399/799] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:54.882164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:54.922143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:54.963741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 401/800] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:31:55.020384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0ef3-feaf-45e2-97da-bc365c8ef995 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.061500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.062522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.062984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.063429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.064495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:55.064991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.067334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.081242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 400/801] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:55.087565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.207480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014949-8a28-4486-b3a8-39e877dac4e6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.223401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:55.241326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.247999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.248658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.248931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.249185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.257314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.259262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:55.271769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:55.273955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:55.277317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 402/802] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:55.281298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.358092 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:55.369909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5021-0dd1-46e7-b8e2-dcd01a0abf06 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.406081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9482c-aef8-4179-af06-f24ac434f6ef None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.412695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.413331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.413620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.414201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.415624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.417062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.418847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 401/803] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:55.425377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.447779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.448407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.448680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.448949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.457475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:55.457475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.457475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.475448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 403/804] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:31:55.481491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.514389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:55.542662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766c6f-89d1-47d5-946f-7affc679b445 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.577303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.577942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.578217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.578480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.579122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.580546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.584410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32a5b-8d3b-4ddd-8ce8-e08339d8d706 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.613607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 402/805] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:31:55 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:31:55.621837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.622496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.622765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.623089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.635812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.637300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:55.653340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:55.654515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:55.655732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:55.655732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:55.655732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:55.655732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 404/806] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:31:55.660674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.678857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:55.774951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a0aa-42d9-48b5-94b3-ef297afd1618 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.814248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.814796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.815072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.815340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.815988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:55.816293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.817711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.830457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 403/807] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:55.836598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:55.924558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:55.941608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffd65-d47d-4f25-ae28-3cd79ec59394 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:55.976754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:55.977378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:55.977688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:55.977963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:55.984884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:55.986330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:31:55.997673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:55.998586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:31:56.000298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 405/808] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:56.004813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:56.088136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:56.116236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4726c-ae74-4cb9-a3e9-50dea298ce29 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:56.151048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:56.151682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:56.151961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:56.152227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:56.152916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:56.153219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:56.154750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752378e7-3bd3-451d-a5b6-844414cdb433 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:56.168436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 404/809] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:56.174555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:56.277792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa9-049e-4710-a352-eefd42fd8d43 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:56.312979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:56.313668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:56.313945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:56.314196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/9e33c08a33c94d79833b3a75fe6a97e9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:56.316360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=dd4de9ba564044ab8a8f835faae23ab6, role_id=9e33c08a33c94d79833b3a75fe6a97e9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:56.317834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110f30-de93-41cb-8d24-d928869e8699 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:56.332127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 406/810] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:56 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/dd4de9ba564044ab8a8f835faae23ab6/roles/9e33c08a33c94d79833b3a75fe6a97e9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:31:57.781770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1baf8-17cf-4920-8142-74857d3c1645 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:57.782324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1baf8-17cf-4920-8142-74857d3c1645 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:57.782324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1baf8-17cf-4920-8142-74857d3c1645 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:57.783581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 405/811] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:57.788918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:57.789462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:57.789626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:57.797240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:57.808967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:57.810178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:57.879964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 407/812] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:58.143609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1baf8-17cf-4920-8142-74857d3c1645 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.252837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1baf8-17cf-4920-8142-74857d3c1645 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.287206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.287822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.288090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.288352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.290351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:58.300571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-008b5415-07e8-4bc4-a620-ad43668ef59c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:58.305829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:58.306954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:58.308222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 406/813] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:58.313196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.422737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a11c-e69e-430d-b36d-602b47a06279 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.455341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976554-6a24-4bcb-ac82-b733115547f8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.455684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976554-6a24-4bcb-ac82-b733115547f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.455956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976554-6a24-4bcb-ac82-b733115547f8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.457953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 407/814] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:31:58.460467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.461180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.461521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.461912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.462588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:58.462892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:58.463171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.463454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.463718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.464260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:58.465828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:58.474244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 408/815] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:58.480350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.482650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:31:58.483831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:31:58.550618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 408/816] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:31:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:31:58.581073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63156-e5ab-4fb4-a72d-d4c409868b7f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.616237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.616858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.617135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.617547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] PATH_INFO: `/v3/users/ba3586ae86954872b4d82c43fc64ad71` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.631697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] RBAC: Authorizing `identity:get_user(user_id=ba3586ae86954872b4d82c43fc64ad71)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:58.633241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:58.635026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 409/817] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/users/ba3586ae86954872b4d82c43fc64ad71 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:58.641244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.744307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c190c-8287-44c5-be55-d4a13a7698ad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.768398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:58.779735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.780367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.780643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.780911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.782198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] RBAC: Authorizing `identity:get_project(project_id=b138e069417240f1b0cd9e76ff486836)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:58.783631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:58.785266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 409/818] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/projects/b138e069417240f1b0cd9e76ff486836 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:58.791427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.822043 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:58.850956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:58.897340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8cfb-b749-41fd-a484-04bcce9b4c3f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.926911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab0bb6-13a6-4e98-9c7b-ae5b73845d1b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:58.931838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.932519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.932796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.933066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836/users/ba3586ae86954872b4d82c43fc64ad71/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.935003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b138e069417240f1b0cd9e76ff486836, user_id=ba3586ae86954872b4d82c43fc64ad71, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:58.936449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:58.951406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 410/819] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:31:58 2022] PUT /identity/v3/projects/b138e069417240f1b0cd9e76ff486836/users/ba3586ae86954872b4d82c43fc64ad71/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:31:58.961735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:58.962470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:58.962661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:58.962934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:58.975643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:31:58.980828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:58.981912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:58.982753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 410/820] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:58.988381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.100308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1e93-d14a-4b61-98ee-24eff2975dd8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.116604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:59.140673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.141293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.141635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.141893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:59.142559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:59.142862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:59.144238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:59.153351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 411/821] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Oct 17 17:31:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:59.159456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.218294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:59.270966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead56a7-5070-4bfa-8e21-c5b1c2b0f7de None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.308976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.309620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.309915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.310179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:59.321299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:59.322751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:31:59.336983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:59.338026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:31:59.339099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:31:59.339099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:31:59.339099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:59.341725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 411/822] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:59.343953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.450749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1ef1-ed37-4eb5-b5fa-bc2fde282d8a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.486672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.487281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.487562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.487836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:59.488480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:59.488778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:59.490181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:59.503376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 412/823] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:59.509526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.617070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112f2-b0a5-47d2-83dc-19ca730a49bf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.619977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:59.654404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.655042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.655316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.655585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:59.663306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:59.665099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:31:59.676318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:31:59.677225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:31:59.678190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 412/824] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Oct 17 17:31:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:31:59.683820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.719893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:31:59.784527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948e9b-8354-4eab-9dc0-67e4afff680d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.819574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.820296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.820536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.820796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:31:59.821558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:31:59.821907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:31:59.823337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:31:59.841381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 413/825] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Oct 17 17:31:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:31:59.847263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:31:59.950704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744d1-57dd-45fe-b1c5-3ecc9bea3917 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:31:59.986360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:31:59.986888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:31:59.987164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:31:59.987436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:00.019291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:00.058790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:00.060240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:00.162532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 413/826] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:31:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:32:00.168691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:00.266167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:00.273926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d6c63-99c5-497c-b802-62f909e96c7f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:00.430766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:00.431399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:00.431685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:00.431937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:00.444489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:00.446119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:32:00.461859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:00.462962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:32:00.463840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:32:00.463840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:32:00.463840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:32:00.463840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 414/827] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:00.469245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:00.533365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:00.572479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ae711-db3b-46d1-b454-43d0e763898b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:00.608288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:00.608884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:00.609153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:00.609474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:00.610150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:00.610468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:00.611818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:00.623724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 414/828] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:00.629905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:00.735993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3a3f-3ec9-4e83-b29d-f36d091e723e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:00.770750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:00.771381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:00.771652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:00.771918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:00.779422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:00.780835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:32:00.792131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:00.793127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:32:00.794056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 415/829] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:00.799514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:00.904957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3376f-b79e-41a8-99e8-a817c7f79c78 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:00.929332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:00.941316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:00.941966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:00.942248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:00.942518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:00.943243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:00.943551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:00.945050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04ceb-cd85-4e79-9994-0bc5b45e5649 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:00.958113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 415/830] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:00.965385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:00.975245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:01.076549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e255-f592-44d8-943a-7da9b9c59d68 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:01.091047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c907fa-1f93-4db0-8c72-b3441bc99872 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.091429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c907fa-1f93-4db0-8c72-b3441bc99872 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.091761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c907fa-1f93-4db0-8c72-b3441bc99872 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.093178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 416/831] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:01.098058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.098332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.098593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.112268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:01.112873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.113150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.113422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.114186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] RBAC: Adding query filter params (role.id=9e33c08a33c94d79833b3a75fe6a97e9, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=dd4de9ba564044ab8a8f835faae23ab6) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:01.114503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:01.115940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:01.117054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:01.118420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:01.122498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 416/832] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:32:00 2022] GET /identity/v3/role_assignments?user.id=dd4de9ba564044ab8a8f835faae23ab6&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=9e33c08a33c94d79833b3a75fe6a97e9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:01.196297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 417/833] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:01.459722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:01.535146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:01.568425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c1ed-9eca-4965-8f99-4d968ecc7bc6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:01.603367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:01.604005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.604285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.604555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.615280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:32:01.620114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:01.621041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:32:01.621930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 417/834] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:01.628152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:01.740182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8188462-5749-4826-93b4-494a4ed08563 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:01.756108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:01.781747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:01.782366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.782644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.782918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.783658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:01.783886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:01.785260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:01.794580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 418/835] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:01.800757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:01.910828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953250e1-e310-403a-8f58-3ed855ed366c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:01.941546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:01.948608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:01.949249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:01.949526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:01.949822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] PATH_INFO: `/v3/users/ba3586ae86954872b4d82c43fc64ad71` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:01.950939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] RBAC: Authorizing `identity:get_user(user_id=ba3586ae86954872b4d82c43fc64ad71)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:01.952353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:01.954999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 418/836] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:01 2022] GET /identity/v3/users/ba3586ae86954872b4d82c43fc64ad71 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:01.961334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:02.072670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d1a-e0a7-4b11-9413-597b3c2a5437 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:02.110326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:02.110927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:02.111200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:02.111442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:02.165372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:02.190504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:02.191998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:02.298817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 419/837] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:32:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:32:02.308364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:02.419169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9d50-65bf-4bf6-bfe8-3246f6eac745 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:02.454687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:02.455326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:02.455602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:02.455869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:02.456990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] RBAC: Authorizing `identity:get_project(project_id=b138e069417240f1b0cd9e76ff486836)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:02.458440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702dab2-5c56-4552-b4b1-103f2dfbf590 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:02.460101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 419/838] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:02 2022] GET /identity/v3/projects/b138e069417240f1b0cd9e76ff486836 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:02.466771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:02.556233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:02.583050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9904-7a42-442d-b019-9abed22a7fb3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:02.634848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:02.635452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:02.635726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:02.635994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:02.636708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=b138e069417240f1b0cd9e76ff486836, user.id=ba3586ae86954872b4d82c43fc64ad71) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:02.637013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:02.638457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786312c7-084c-448b-ac35-d3ffbbf1efa9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:02.645038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 420/839] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:32:02 2022] GET /identity/v3/role_assignments?user.id=ba3586ae86954872b4d82c43fc64ad71&scope.project.id=b138e069417240f1b0cd9e76ff486836&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:04.751920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88043225-08c1-4036-a7c6-fd5d7e716d87 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:04.752505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88043225-08c1-4036-a7c6-fd5d7e716d87 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:04.752505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88043225-08c1-4036-a7c6-fd5d7e716d87 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:04.753784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 420/840] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:04.762756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:04.763433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:04.763587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:04.786967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:04.788158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:04.873726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 421/841] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:05.143984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88043225-08c1-4036-a7c6-fd5d7e716d87 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:05.228699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:05.266526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88043225-08c1-4036-a7c6-fd5d7e716d87 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:05.301919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:05.302545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:05.302815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:05.303089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:05.304247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:05.306089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f0e4-3fee-47bb-a657-5ff56e7fbfbb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:05.307664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 421/842] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:05.314369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:05.385476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:05.429906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc727-5182-46c8-b084-6a4bd11d19d8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:05.466474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:05.467084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:05.467339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:05.467628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:05.468285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:05.469753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5540d-1081-4622-b739-b3e85ea8b05a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:05.492045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 422/843] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:32:05 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:32:07.703356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c814e-7a2c-4bfc-a289-2f50731a3e8c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:07.704268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c814e-7a2c-4bfc-a289-2f50731a3e8c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:07.704268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c814e-7a2c-4bfc-a289-2f50731a3e8c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:07.706400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 422/844] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:07.712498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:07.712937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:07.713036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:07.732533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:07.733749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:07.806410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 423/845] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:08.092078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c814e-7a2c-4bfc-a289-2f50731a3e8c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:08.208855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c814e-7a2c-4bfc-a289-2f50731a3e8c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:08.245596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:08.246247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:08.246518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:08.246785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] PATH_INFO: `/v3/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:08.248255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] RBAC: Authorizing `identity:get_role(role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:08.249963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:08.251275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 423/846] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:08 2022] GET /identity/v3/roles/291c5a802e814346bb3421d0737828c8 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:08.258745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:08.335468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:08.399965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16365-20e3-4847-bd0c-894c3cb767b9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:08.438146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:08.438785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:08.439064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:08.439338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] PATH_INFO: `/v3/users/4a9143586fa241f5aeacd2986a9166b5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:08.457092 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] RBAC: Authorizing `identity:get_user(user_id=4a9143586fa241f5aeacd2986a9166b5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:08.459468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:08.461826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 424/847] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:08 2022] GET /identity/v3/users/4a9143586fa241f5aeacd2986a9166b5 => generated 286 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:08.470655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:08.473881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:08.581452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024d24-17e2-4e52-a6d3-02241c7dc752 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:08.621720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:08.622346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:08.622621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:08.622889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:08.624535 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] RBAC: Authorizing `identity:get_project(project_id=b138e069417240f1b0cd9e76ff486836)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:08.626007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4420-cae4-4f3e-821c-0a305508200c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:08.627645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 424/848] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:08 2022] GET /identity/v3/projects/b138e069417240f1b0cd9e76ff486836 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:08.634566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:08.752270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33883319-48c1-4a6f-a81e-6aff9210b94d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:08.768408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:08.791788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:08.792456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:08.792726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:08.792997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836/users/4a9143586fa241f5aeacd2986a9166b5/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:08.795619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] RBAC: Authorizing `identity:create_grant(project_id=b138e069417240f1b0cd9e76ff486836, user_id=4a9143586fa241f5aeacd2986a9166b5, role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:08.797035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb336e0d-955e-46a6-b82a-3df976c2fa23 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:08.811463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 425/849] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:32:08 2022] PUT /identity/v3/projects/b138e069417240f1b0cd9e76ff486836/users/4a9143586fa241f5aeacd2986a9166b5/roles/291c5a802e814346bb3421d0737828c8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:32:10.962016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b483b4-b672-46e4-b95e-f06dcf4bcc5e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:10.962567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b483b4-b672-46e4-b95e-f06dcf4bcc5e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:10.962567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b483b4-b672-46e4-b95e-f06dcf4bcc5e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:10.963922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 425/850] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:10.970583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:10.971263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:10.971448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:10.998549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:11.000088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:11.072687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 426/851] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:11.359143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b483b4-b672-46e4-b95e-f06dcf4bcc5e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:11.437291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:11.473282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b483b4-b672-46e4-b95e-f06dcf4bcc5e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:11.513329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:11.513981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:11.514259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:11.514530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] PATH_INFO: `/v3/roles/291c5a802e814346bb3421d0737828c8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:11.515979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] RBAC: Authorizing `identity:get_role(role_id=291c5a802e814346bb3421d0737828c8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:11.517342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:11.518745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 426/852] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:11 2022] GET /identity/v3/roles/291c5a802e814346bb3421d0737828c8 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:11.526156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:11.644078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d02a4c-cc57-4644-94fb-790f4ceecf94 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:11.646401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:11.681675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:11.682312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:11.682590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:11.682856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] PATH_INFO: `/v3/users/4a9143586fa241f5aeacd2986a9166b5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:11.684034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] RBAC: Authorizing `identity:get_user(user_id=4a9143586fa241f5aeacd2986a9166b5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:11.685473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:11.687107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 427/853] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:11 2022] GET /identity/v3/users/4a9143586fa241f5aeacd2986a9166b5 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:11.695901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:11.813320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee1a9-7174-4178-89f6-f76716c6c6d6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:11.851637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:11.852278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:11.852555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:11.852822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:11.862357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:11.925463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:11.926867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:12.035947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 427/854] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:32:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:32:12.043086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:12.180120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc20433-294b-4957-9059-12ca572de88b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:12.218331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:12.218955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:12.219235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:12.219507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] PATH_INFO: `/v3/projects/b138e069417240f1b0cd9e76ff486836` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:12.220720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] RBAC: Authorizing `identity:get_project(project_id=b138e069417240f1b0cd9e76ff486836)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:12.222201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1f27a-bc5f-4cde-bd48-badd25fc5a70 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:12.223883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 428/855] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:12 2022] GET /identity/v3/projects/b138e069417240f1b0cd9e76ff486836 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:12.234464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:12.279340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:12.341188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6db42-c271-431d-a843-051626ca52fe None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:12.379271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:12.379856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:12.380123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:12.380388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:12.381109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] RBAC: Adding query filter params (role.id=291c5a802e814346bb3421d0737828c8, scope.project.id=b138e069417240f1b0cd9e76ff486836, user.id=4a9143586fa241f5aeacd2986a9166b5) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:12.381417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:12.382882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22933f-4160-4c0b-9496-f64d4984575f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:12.389288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 428/856] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:32:12 2022] GET /identity/v3/role_assignments?user.id=4a9143586fa241f5aeacd2986a9166b5&scope.project.id=b138e069417240f1b0cd9e76ff486836&role.id=291c5a802e814346bb3421d0737828c8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:14.494667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac41-4a14-4285-9c81-3727985d10a7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:14.495199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac41-4a14-4285-9c81-3727985d10a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:14.495199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac41-4a14-4285-9c81-3727985d10a7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:14.496616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 429/857] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:14.503334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:14.504072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:14.504215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:14.530821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:14.532020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:14.603143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 429/858] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:14.869762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ac41-4a14-4285-9c81-3727985d10a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:14.920395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:14.988756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ac41-4a14-4285-9c81-3727985d10a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:15.026560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:15.027175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:15.027449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:15.027715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:15.028870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:15.030336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66684a-5353-4bda-bd80-211d566a8d48 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:15.031900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 430/859] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:15.037974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:15.070119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:15.143233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026537-97c6-4b48-a9b5-9e624156a2c6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:15.179111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:15.179723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:15.179998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:15.180265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:15.180906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:15.182357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466e31e-7010-4ddc-9745-93e8b3fc8d89 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:15.213681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 430/860] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:32:15 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:32:17.365485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ea44-d6a8-4f0f-ac92-bb0298044a0c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:17.366376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ea44-d6a8-4f0f-ac92-bb0298044a0c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:17.366376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ea44-d6a8-4f0f-ac92-bb0298044a0c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:17.368676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 431/861] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:17.377934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:17.378356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:17.378527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:17.399830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:17.401052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:17.472558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 431/862] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:17.736088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ea44-d6a8-4f0f-ac92-bb0298044a0c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:17.845892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ea44-d6a8-4f0f-ac92-bb0298044a0c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:17.856477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:17.893976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:17.894597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:17.894877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:17.895144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:17.896325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:17.897791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b14f7-b9a8-4633-ab25-9dfecd945a02 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:17.899513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 432/863] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:17.905614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:17.922368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:18.029818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90958803-b671-4d0b-a66a-1783d1b38338 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:18.072891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:18.073492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:18.073809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:18.074080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:18.074736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:18.076168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd75f77-1ef2-444d-876a-7be3b8876e5b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:18.100688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 432/864] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:32:17 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:32:20.283391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04be1d-9bb0-412e-ad7f-bc6ebab0b4ba None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:20.284234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04be1d-9bb0-412e-ad7f-bc6ebab0b4ba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:20.284234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04be1d-9bb0-412e-ad7f-bc6ebab0b4ba None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:20.286403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 433/865] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:20.296062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:20.296742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:20.296831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:20.324789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:20.326029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:20.394299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:20.400438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 433/866] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:20.669294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04be1d-9bb0-412e-ad7f-bc6ebab0b4ba None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:20.786590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04be1d-9bb0-412e-ad7f-bc6ebab0b4ba None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:20.822639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:20.823254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:20.823526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:20.823791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:20.834396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:32:20.839135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:20.840182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:32:20.841364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 434/867] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:20.846444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:20.947729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af9e0b-45b1-4871-b0f9-ceadebed453f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:20.982338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:20.982926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:20.983198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:20.983459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:20.984117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:20.984410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:20.985785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:20.994267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 434/868] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:21.004193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:21.046740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:21.117061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903c16-f793-4167-8a01-995a02e83488 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:21.156299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:21.156928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:21.157205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:21.157481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] PATH_INFO: `/v3/users/0aa3e6e4a7fe440293caf197cd11f7e5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:21.171846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa3e6e4a7fe440293caf197cd11f7e5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:21.173289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:21.174915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 435/869] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:21 2022] GET /identity/v3/users/0aa3e6e4a7fe440293caf197cd11f7e5 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:21.182006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:21.248653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:21.288926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2a90-e9e7-4a9d-b2e0-a2bbd745d537 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:21.328828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:21.329478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:21.329765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:21.330039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] PATH_INFO: `/v3/projects/93b62f83f2304156960d4cbebc0e4f35` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:21.331191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] RBAC: Authorizing `identity:get_project(project_id=93b62f83f2304156960d4cbebc0e4f35)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:21.332637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dd73-cb71-476d-9a27-3bb410cdd9fa None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:21.334329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 435/870] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:21 2022] GET /identity/v3/projects/93b62f83f2304156960d4cbebc0e4f35 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:21.340877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:21.443722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:21.448347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef1db7-1990-46fd-98ba-d1de9d4a9029 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:21.485926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:21.486681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:21.486953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:21.487217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] PATH_INFO: `/v3/projects/93b62f83f2304156960d4cbebc0e4f35/users/0aa3e6e4a7fe440293caf197cd11f7e5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:21.489345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=93b62f83f2304156960d4cbebc0e4f35, user_id=0aa3e6e4a7fe440293caf197cd11f7e5, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:21.490802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec33fd-2315-4ec7-96bb-387e00725e6b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:21.508924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 436/871] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:32:21 2022] PUT /identity/v3/projects/93b62f83f2304156960d4cbebc0e4f35/users/0aa3e6e4a7fe440293caf197cd11f7e5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:32:23.640122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c68c-8a5b-4527-a987-bc88e439b5b5 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:23.640666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c68c-8a5b-4527-a987-bc88e439b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:23.640666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c68c-8a5b-4527-a987-bc88e439b5b5 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:23.642879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 436/872] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:23.650799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:23.651419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:23.651419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:23.671645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:23.672818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:23.743091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 437/873] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:32:24.021083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c68c-8a5b-4527-a987-bc88e439b5b5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:24.131934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6c68c-8a5b-4527-a987-bc88e439b5b5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:24.163043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:24.170100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:24.170726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:24.171000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:24.171271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:24.182774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:32:24.187513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:24.188651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:32:24.189819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 437/874] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:24.195158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:24.302055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:24.321029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cd4fb-0713-4386-b5eb-4e68dca030b7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:24.357510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:24.358175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:24.358452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:24.358719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:24.359378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:24.359677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:24.361046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:24.369781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 438/875] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:32:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:24.376393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:24.492499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a43c-fa75-4cd1-a171-ac814b494982 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:24.529093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:24.529734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:24.530004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:24.530271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] PATH_INFO: `/v3/users/0aa3e6e4a7fe440293caf197cd11f7e5` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:24.531437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa3e6e4a7fe440293caf197cd11f7e5)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:24.532847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:24.534454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 438/876] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:24 2022] GET /identity/v3/users/0aa3e6e4a7fe440293caf197cd11f7e5 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:24.541107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:24.649138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51f91-cf6d-43c1-ab04-075122b893dd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:24.685127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:24.685849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:24.686051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:24.686327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:24.702261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:24.756413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:24.758049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:24.860524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 439/877] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:32:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 17:32:24.867506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:24.938139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:24.987991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8bf7-a06c-4c92-8e3e-75aa16aa8eb3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:25.029817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:25.030450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:25.030727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:25.030995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] PATH_INFO: `/v3/projects/93b62f83f2304156960d4cbebc0e4f35` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:25.032170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] RBAC: Authorizing `identity:get_project(project_id=93b62f83f2304156960d4cbebc0e4f35)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:25.033650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ab973-2c1e-4d6d-8ef7-1886b016031f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:25.035282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 439/878] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:24 2022] GET /identity/v3/projects/93b62f83f2304156960d4cbebc0e4f35 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:25.041960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:25.091866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:25.153513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563992-1318-40c1-b729-52a3a7de222a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:25.191072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:25.191597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:25.191871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:25.192136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:25.192844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=93b62f83f2304156960d4cbebc0e4f35, user.id=0aa3e6e4a7fe440293caf197cd11f7e5) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:25.193146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:25.194770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b523-c61d-44bb-97d1-a43b8477d353 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:25.200637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 440/879] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:32:25 2022] GET /identity/v3/role_assignments?user.id=0aa3e6e4a7fe440293caf197cd11f7e5&scope.project.id=93b62f83f2304156960d4cbebc0e4f35&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:27.331025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c92d9-c911-4426-ae33-d7a26e1b7174 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:27.331631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c92d9-c911-4426-ae33-d7a26e1b7174 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:27.331631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c92d9-c911-4426-ae33-d7a26e1b7174 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:27.332928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 440/880] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:27.339477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac9fc-38a7-4e60-8249-fef1a5c65f73 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:27.339899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac9fc-38a7-4e60-8249-fef1a5c65f73 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:27.340048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac9fc-38a7-4e60-8249-fef1a5c65f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:27.368754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f28ac9fc-38a7-4e60-8249-fef1a5c65f73 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:27.369972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f28ac9fc-38a7-4e60-8249-fef1a5c65f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:27.441366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 441/881] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:27.726148 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c92d9-c911-4426-ae33-d7a26e1b7174 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:27.844217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c92d9-c911-4426-ae33-d7a26e1b7174 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:27.871900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:27.882173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:27.882834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:27.883109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:27.883372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:27.884037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:27.885412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397f968-72d1-4dc3-8a68-1a897d5c2e3b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:27.904458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 441/882] 10.222.0.62 () {60 vars in 1138 bytes} [Mon Oct 17 17:32:27 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:32:30.088252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd5fd-eef4-4a42-a1ad-4c6f003c73e0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:30.089147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd5fd-eef4-4a42-a1ad-4c6f003c73e0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:30.089147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd5fd-eef4-4a42-a1ad-4c6f003c73e0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:30.091326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 442/883] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:30.097803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:30.098251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:30.098359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:30.122130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:30.124375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:30.201767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 442/884] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:30.468859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cd5fd-eef4-4a42-a1ad-4c6f003c73e0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:30.514627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:30.577786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cd5fd-eef4-4a42-a1ad-4c6f003c73e0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:30.613752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:30.614371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:30.614654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:30.614954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] PATH_INFO: `/v3/domains/226f0e48bb7f4df0b8a4ae0d1032e068` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:30.627639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=226f0e48bb7f4df0b8a4ae0d1032e068)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:30.629114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8392bf-012d-4765-b001-1e199feec9c9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:30.630812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 443/885] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Oct 17 17:32:30 2022] GET /identity/v3/domains/226f0e48bb7f4df0b8a4ae0d1032e068 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:30.637232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:30.752110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416d24a-ebfa-489d-9187-87b5e56b7f50 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:30.770072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:30.792664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:30.793266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:30.793541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:30.793833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:30.794478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:30.795902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da34b-8763-4568-b475-d8ca319e5615 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:30.825032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 443/886] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:32:30 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:32:33.037630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b650a-52ec-4ad0-a0d1-77c0d019db9f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:33.038406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b650a-52ec-4ad0-a0d1-77c0d019db9f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:33.038635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b650a-52ec-4ad0-a0d1-77c0d019db9f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:33.040086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 444/887] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:33.046747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:33.047175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:33.047342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:33.074935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:33.076136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:33.158679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 444/888] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:33.431348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b650a-52ec-4ad0-a0d1-77c0d019db9f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:33.547431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:33.551796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b650a-52ec-4ad0-a0d1-77c0d019db9f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:33.590472 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:33.591111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:33.591388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:33.591660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] PATH_INFO: `/v3/domains/226f0e48bb7f4df0b8a4ae0d1032e068` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:33.592810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=226f0e48bb7f4df0b8a4ae0d1032e068)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:33.594288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0c6c-a6d4-4d44-b178-c75dfd878b15 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:33.595875 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 445/889] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Oct 17 17:32:33 2022] GET /identity/v3/domains/226f0e48bb7f4df0b8a4ae0d1032e068 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:33.602061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:33.715269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:33.719159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bcdd5-8f7d-4ec7-aa93-f9fd196bf1c0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:33.758621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:33.759218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:33.759495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:33.759767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:33.760406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:33.762018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748665-df48-4415-b358-7d2bd821e0e6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:33.786474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 445/890] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:32:33 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:32:36.059919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfbd3-69fb-4b5f-9a0e-a3b457768135 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:36.060494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfbd3-69fb-4b5f-9a0e-a3b457768135 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:36.060494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfbd3-69fb-4b5f-9a0e-a3b457768135 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:36.061862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 446/891] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:36.068256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:36.069008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:36.069320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:36.088892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:36.090108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:36.168894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 446/892] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:36.443553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bfbd3-69fb-4b5f-9a0e-a3b457768135 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:36.563057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bfbd3-69fb-4b5f-9a0e-a3b457768135 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:36.599130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:36.599754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:36.600029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:36.600350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:36.610756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:32:36.615476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:36.616755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:32:36.617687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 447/893] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:36.625607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:36.710164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:36.729876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dd9a3-1f80-4e58-8804-7556c2572cf1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:36.767684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:36.768287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:36.768565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:36.768837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:36.769495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:36.769826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:36.771191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:36.779285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 447/894] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:36.785540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:36.820808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:36.912347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73351435-f127-4d4f-a99c-af6738268cf2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:36.947458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:36.948081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:36.948360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:36.948627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] PATH_INFO: `/v3/users/4f23c1e28ff44995a589c89e8d02ab52` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:36.962284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] RBAC: Authorizing `identity:get_user(user_id=4f23c1e28ff44995a589c89e8d02ab52)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:36.963689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:36.965361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 448/895] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:36 2022] GET /identity/v3/users/4f23c1e28ff44995a589c89e8d02ab52 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:36.972216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:37.085557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea59d87-99da-43de-a8f5-6a45000308bf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:37.120994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:37.121624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:37.121935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:37.122204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] PATH_INFO: `/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:37.123466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] RBAC: Authorizing `identity:get_project(project_id=bc2b7599c59e4dd78599b8324fe3ec82)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:37.125316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e144c33-9944-4f46-9c5c-6b8abfdab11c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:37.126988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 448/896] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:36 2022] GET /identity/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:37.133406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:37.227717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:37.245449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0408a-0bea-4d97-8d11-9ce0ed4318db None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:37.280471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:37.281136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:37.281411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:37.281708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] PATH_INFO: `/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82/users/4f23c1e28ff44995a589c89e8d02ab52/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:37.283647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b7599c59e4dd78599b8324fe3ec82, user_id=4f23c1e28ff44995a589c89e8d02ab52, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:37.285097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a62cb5-ec27-4f14-82e5-2c2a9125ed86 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:37.301608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 449/897] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:32:37 2022] PUT /identity/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82/users/4f23c1e28ff44995a589c89e8d02ab52/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:32:39.491928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9cf9-53a2-482e-a1e0-6413e5d7a00e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:39.492524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9cf9-53a2-482e-a1e0-6413e5d7a00e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:39.492524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9cf9-53a2-482e-a1e0-6413e5d7a00e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:39.493928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 449/898] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:32:39.500861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:39.501628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:39.501776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:39.529111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:32:39.530364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:32:39.612112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 450/899] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:32:39.909773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd9cf9-53a2-482e-a1e0-6413e5d7a00e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:39.928054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:40.027146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd9cf9-53a2-482e-a1e0-6413e5d7a00e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:40.068023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:40.068654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:40.069076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:40.069607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:40.082087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:32:40.086880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:32:40.087978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:32:40.089156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 450/900] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:32:40.094832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:40.183322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:40.208126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde995d-34cf-48da-b632-2e136e4eb7e8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:40.244319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:40.244926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:40.245195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:40.245461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:40.246168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:40.246473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:40.247869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:40.256466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 451/901] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:32:40.266931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:40.353380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:40.382993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e41fb-b7e7-4d88-b53d-f0e0e8ec8268 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:40.418436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:40.419067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:40.419341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:40.419618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] PATH_INFO: `/v3/users/4f23c1e28ff44995a589c89e8d02ab52` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:40.420785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] RBAC: Authorizing `identity:get_user(user_id=4f23c1e28ff44995a589c89e8d02ab52)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:40.422255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:40.423875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 451/902] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Oct 17 17:32:40 2022] GET /identity/v3/users/4f23c1e28ff44995a589c89e8d02ab52 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:40.430082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:40.544114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995225-2c66-454a-9580-b68bb13a2e2b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:40.580712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:40.581327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:40.581616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:40.581906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:40.591282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:40.654863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:40.656316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:40.766021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 452/903] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:32:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:32:40.774747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:40.884917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797b39d-3e0b-4e52-9801-c36d37c0e279 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:40.920214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:40.920840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:40.921116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:40.921385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] PATH_INFO: `/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:40.922595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] RBAC: Authorizing `identity:get_project(project_id=bc2b7599c59e4dd78599b8324fe3ec82)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:40.924026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71288-aaeb-4470-a1be-7c20f938f18c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:40.925688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 452/904] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Oct 17 17:32:40 2022] GET /identity/v3/projects/bc2b7599c59e4dd78599b8324fe3ec82 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:40.932895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:32:40.988242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:41.050782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db4cb-77d2-4011-b4b9-99cfd0585524 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:32:41.097801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:32:41.098772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:32:41.099242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:32:41.099684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:32:41.100958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=bc2b7599c59e4dd78599b8324fe3ec82, user.id=4f23c1e28ff44995a589c89e8d02ab52) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:32:41.101268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:32:41.102730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1978a-bfbc-4a4a-a3bc-2e9f0714b67e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:32:41.110061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 453/905] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:32:40 2022] GET /identity/v3/role_assignments?user.id=4f23c1e28ff44995a589c89e8d02ab52&scope.project.id=bc2b7599c59e4dd78599b8324fe3ec82&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:32:50.915509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:32:51.106726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=49 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:37.392168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ea43-f2a8-417a-8307-734506746f1c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:37.392168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ea43-f2a8-417a-8307-734506746f1c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:37.392168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ea43-f2a8-417a-8307-734506746f1c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:37.393241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 453/906] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:33:37.400168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:37.400913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:37.400913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:37.423314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:33:37.424646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:33:37.522189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 454/907] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:33:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:33:37.804445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ea43-f2a8-417a-8307-734506746f1c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:37.942587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ea43-f2a8-417a-8307-734506746f1c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:37.984544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:37.985487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:37.985852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:37.986149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:38.002827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:38.004523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:38.022876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:38.024106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:38.025130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:38.025130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:38.025130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:38.025130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 454/908] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:38.034574 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:38.171833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2103cd-b7bc-402b-8fe8-b1327148040a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:38.207170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:38.215879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:38.216762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:38.217113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:38.217463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:38.218260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:38.218684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:38.220364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7ceb-9d3b-4673-895a-9891ed614f6d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:38.235888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 455/909] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:38.242614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:38.309199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:38.365172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e235-9ce7-42bb-9fd9-0996cceb6d14 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:38.410352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:38.411028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:38.411425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:38.411840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:38.412969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:38.414966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51094ad-7a55-4bb9-b1c3-b7783e4060e8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:38.446773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 455/910] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Oct 17 17:33:38 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:33:40.870310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61b74-705b-4133-a829-a6374578784a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:40.870310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61b74-705b-4133-a829-a6374578784a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:40.870310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61b74-705b-4133-a829-a6374578784a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:40.871909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 456/911] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:33:40.879447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:40.881227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:40.881227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:40.902090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:33:40.903722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:33:40.991233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 456/912] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:33:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:33:41.284621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc61b74-705b-4133-a829-a6374578784a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:41.412928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc61b74-705b-4133-a829-a6374578784a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:41.457292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:41.458199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:41.458699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:41.459171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:41.470496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:33:41.475681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:41.478151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:41.479103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 457/913] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:33:41.482867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:41.526015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:41.596781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5acd5-d552-45cb-aa5d-cf0a8b2d7c1f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:41.636619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:41.637520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:41.637820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:41.638088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:41.638751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:41.639044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:41.640385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:41.653752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 457/914] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:41.654984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:41.713720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:41.769760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e3743-6880-42ab-8d70-3779c3dcc60e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:41.811120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:41.811802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:41.812119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:41.812354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:41.824524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:41.826072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:41.847259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:41.848391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:41.849640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:41.849640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:41.849640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:41.853678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 458/915] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:33:41.858236 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:41.972404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:41.975715 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9784-ff8e-43c5-99d5-7404f44a258a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.014048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.014674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.014936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.015328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.015973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:42.016274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.017671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.033527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 458/916] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:42.039167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:42.163932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08145f88-e916-4f07-a9a7-5aafd58cd4d6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.165734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:42.210686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.211901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.211901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.212084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.220169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.221710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:33:42.237124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:42.238352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:42.239382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 459/917] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:42.244467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:42.363553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86534c6-05b2-4fb3-89a0-0c7caec80efe None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.409218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.409984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.410298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.410653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.411602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:42.412040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.413675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.432384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 459/918] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:42.441487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:42.552485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9720a8-afe3-466a-8b8d-d8436a83de79 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.587677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.588321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.588582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.588883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.603603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.605094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:42.620504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:42.621906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:42.628170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:42.628170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:42.628170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:42.628170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 460/919] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:42.628409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:42.650185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:42.746200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d9c4c-69a3-47fd-b66f-be9c154a1ce2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.783748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.784437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.784744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.784984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.785684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:42.786118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.787477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.804612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 460/920] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:33:42.806169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:42.825260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:42.918595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea9a43-c57c-4ac3-8097-341494e5ec46 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:42.956258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:42.956924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:42.957198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:42.957463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:42.965901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:42.967410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:33:42.979660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:42.980783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:42.981980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 461/921] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 17:33:42.986955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:43.071614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:43.094476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c94f-a280-41d5-81b4-3214bce64f09 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:43.130647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:43.131307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:43.131589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:43.131850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:43.132548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:43.132850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:43.134301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc569e4-bb19-4d87-9028-d7464d1fb882 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:43.147761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 461/922] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:43.154193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:43.241049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:43.274470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c936d-b657-4d5c-9dda-05109381f274 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:43.321471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:43.322297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:43.322449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:43.322743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/a8a289b1980346cc89cd56154b8c32fa/roles/a8276fa7040a4ab3a86736759b1205c1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:43.338436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=a8a289b1980346cc89cd56154b8c32fa, role_id=a8276fa7040a4ab3a86736759b1205c1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:43.339869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950f238-4885-4779-ac08-ff812bce776c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:43.355595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 462/923] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:33:43 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/a8a289b1980346cc89cd56154b8c32fa/roles/a8276fa7040a4ab3a86736759b1205c1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:33:45.643346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a0e3-3476-4f93-8997-a4c494f5eaf9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:45.643911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a0e3-3476-4f93-8997-a4c494f5eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:45.643911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a0e3-3476-4f93-8997-a4c494f5eaf9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:45.645912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 462/924] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:33:45.651465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:45.652032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:45.652032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:45.673026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:33:45.674323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:33:45.747133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 463/925] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:33:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:33:46.035104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840a0e3-3476-4f93-8997-a4c494f5eaf9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:46.149442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840a0e3-3476-4f93-8997-a4c494f5eaf9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:46.190022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:46.190657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:46.190933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:46.191202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:46.199738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:46.205365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:33:46.211721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:46.212634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:46.213492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 463/926] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:46.219337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:46.279284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:46.328172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb7ed-ac97-4d92-9a43-4ea133cea777 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:46.367438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:46.368064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:46.368334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:46.368604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:46.369261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:46.369560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:46.370969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:46.379831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 464/927] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:46.386346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:46.496180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f44d-8c36-4244-9750-ef40940c0559 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:46.531682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:46.532394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:46.532684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:46.532938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:46.543306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:46.544788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:46.561756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:46.562973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:46.564053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:46.564053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:46.564053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:46.564053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 464/928] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:46.569593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:46.684491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc224f3-aa78-4bea-90f2-4ed8c3a29d17 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:46.702171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:46.721399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:46.722069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:46.722346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:46.722616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:46.723308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:46.723634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:46.725031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:46.737830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 465/929] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:33:46.744285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:46.803022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:46.864027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3e88a-079f-4076-9b74-b534f9c8e409 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:46.901937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:46.903938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:46.904322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:46.904666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:46.914789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:46.916382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:33:46.930164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:46.931278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:46.932293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 465/930] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:46.937849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:47.054909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac855b-6e27-4794-a4aa-d35697d0e3ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:47.093705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:47.094383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:47.094682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:47.094997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:47.095770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:47.096210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:47.097824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:47.123970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 466/931] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Oct 17 17:33:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:47.125805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:47.247696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0b38-2bd5-4913-9c6e-5987b7f52453 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:47.259468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:47.284825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:47.285487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:47.285907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:47.286302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:47.356442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:47.358377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:47.476326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 466/932] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:33:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 17:33:47.482607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:47.521051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:47.600423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908601e-5958-4258-afc2-70b43c2d9185 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:47.639014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:47.639701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:47.639962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:47.640225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:47.651357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:47.652812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:47.667950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:47.668981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:47.669920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:47.669920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:47.669920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:47.669920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 467/933] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:47.674923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:47.686805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:47.786976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82169-daf8-46e8-a32a-c17b63813c68 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:47.826472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:47.827084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:47.827368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:47.827620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:47.828270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:47.828571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:47.830056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:47.843632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 467/934] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:47.850799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:47.947672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:47.965515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b3806-7aa5-4ca1-bc5d-fb79b85f3f9e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:48.007122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:48.007905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:48.008185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:48.008528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:48.016235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:48.017854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:33:48.029865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:48.030853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:48.031759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 468/935] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:48.038950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:48.113275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:48.155836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35ef2-9746-408d-92b5-f084c433f213 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:48.195790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:48.196438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:48.196721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:48.197001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:48.197744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:48.198088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:48.199531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b009ed-682c-4c8e-ae2b-7d1ae6f07ee2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:48.212178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 468/936] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:48.218617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:48.336380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b4913-f324-4459-9a2b-9a116ad6e337 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:48.373721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:48.374370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:48.374822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:48.375080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:48.376045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] RBAC: Adding query filter params (role.id=a8276fa7040a4ab3a86736759b1205c1, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=a8a289b1980346cc89cd56154b8c32fa) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:48.376496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:48.378178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372534-5537-4280-91cb-d5e5a624bf7e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:48.386791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 469/937] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:33:48 2022] GET /identity/v3/role_assignments?user.id=a8a289b1980346cc89cd56154b8c32fa&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=a8276fa7040a4ab3a86736759b1205c1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:50.646343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304146-db90-4c71-adf8-a74b5c827c96 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:50.646928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304146-db90-4c71-adf8-a74b5c827c96 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:50.646928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e304146-db90-4c71-adf8-a74b5c827c96 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:50.648359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 469/938] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:33:50.653976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:50.654395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:50.654523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:50.673976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:33:50.675303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:33:50.678970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:50.755840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 470/939] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:33:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:33:51.020187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304146-db90-4c71-adf8-a74b5c827c96 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:51.142519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e304146-db90-4c71-adf8-a74b5c827c96 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:51.177844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:51.183629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:51.184259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:51.184534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:51.184843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:51.199357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:33:51.205810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:51.207957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:51.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 470/940] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:51.215505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:51.328607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2dc33-2706-4db3-a437-24ce097e12ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:51.366605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:51.367228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:51.367509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:51.367784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:51.368609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:51.368906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:51.370639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:51.380484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 471/941] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:51.387093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:51.505160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a585b-2c6c-4c3a-9787-fde8c724346d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:51.547284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:51.547942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:51.548243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:51.548577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:51.561367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:51.563314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:51.580832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:51.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:51.583561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:51.583561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:51.583561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:51.583561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 471/942] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:51.588883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:51.592440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:51.704469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838da1ef-f907-44da-ab99-f869abbfe6a9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:51.749841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:51.750885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:51.751209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:51.751502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:51.752658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:51.752932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:51.755112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:51.769289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 472/943] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:51.776150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:51.831596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:51.894320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd898d4-b528-461b-8e55-22cf4bd25cbe None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:51.931458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:51.932380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:51.932657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:51.932927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:51.941657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:51.943382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:33:51.955582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:51.956656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:51.958325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 472/944] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:51.963119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.038289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:52.085601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e2b1d-e35c-4252-98a3-098f5548dd06 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:52.122711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:52.123498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:52.123777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:52.124045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:52.124874 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:52.125239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:52.127032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:52.151926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 473/945] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Oct 17 17:33:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:52.158400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.270844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08074a55-92dd-48c5-aa8f-dcf4f2dfe943 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:52.272614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:52.310184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:52.310815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:52.311086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:52.311351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:52.322122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:52.323609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:52.340853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:52.342248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:52.343314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:52.343314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:52.343314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:52.343314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 473/946] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:52.348823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.468312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a688-e7eb-470c-ac0d-b0e5bad55ebc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:52.494093 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:52.512296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:52.512922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:52.513210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:52.513473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:52.514158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:52.514461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:52.515838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:52.528957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 474/947] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:52.534861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.661998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3376-5d6f-46f2-8861-31dc0cb56e07 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:52.702015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:52.702645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:52.702914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:52.703181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:52.709930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:52.711353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:33:52.724006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:52.725089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:52.731003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 474/948] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:52.731586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.843437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585285d-0883-4440-888d-530ba6a6cd72 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:52.881437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:52.882312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:52.882610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:52.882934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:52.883657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:52.884042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:52.885620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1f6a-e85b-4133-96d2-e1399b529d96 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:52.899622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 475/949] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:52.905853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:52.923805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:53.013964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aed8-a13b-422f-b2a6-21652549d310 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:53.054571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:53.055292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:53.055566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:53.055847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] PATH_INFO: `/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/a8a289b1980346cc89cd56154b8c32fa/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:53.057849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] RBAC: Authorizing `identity:create_grant(project_id=42c02dd9a0e2458896aea742a1ec9a39, user_id=a8a289b1980346cc89cd56154b8c32fa, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:53.059279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4ddbe-79dc-401e-8685-7492274ab11b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:53.080143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 475/950] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Oct 17 17:33:52 2022] PUT /identity/v3/projects/42c02dd9a0e2458896aea742a1ec9a39/users/a8a289b1980346cc89cd56154b8c32fa/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:33:55.374980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d0eb-c2f0-4c76-bba4-a572e1414c68 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:55.375571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d0eb-c2f0-4c76-bba4-a572e1414c68 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:55.375571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d0eb-c2f0-4c76-bba4-a572e1414c68 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:55.377192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 476/951] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:33:55.383632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:55.384144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:55.384144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:55.404536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:33:55.405888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:33:55.484367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 476/952] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:33:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:33:55.746738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d0eb-c2f0-4c76-bba4-a572e1414c68 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:55.796018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:55.861944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d0eb-c2f0-4c76-bba4-a572e1414c68 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:55.901443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:55.902187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:55.902521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:55.902883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:55.916179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 17:33:55.921383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:55.922498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:55.923444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 477/953] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Oct 17 17:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:55.930427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:55.933724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:56.041835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4b14-af1f-44bf-8ba8-af5781626ac2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.078601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.079234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.079498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.079813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:56.080481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:56.080788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:56.082358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:56.090804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 477/954] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Oct 17 17:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:33:56.097526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:56.211583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:56.214677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8283-4e71-4298-be43-8744a8ffb3c1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.252644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.253268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.253539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.253830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:56.264869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:56.266551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:56.281969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:56.286020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:56.287190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:56.287190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:56.287190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:56.287190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 478/955] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:56.289377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:56.362952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:56.400763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4675e0-1898-48c8-92fe-74e905838afc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.440189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.440812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.441079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.441358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:56.442261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:56.442830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:56.444492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:56.460128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 478/956] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:56.466182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:56.569900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e218-8a27-4c76-bb16-24ecd3fa8b29 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.606196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.606949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.607226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.607560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:56.616245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:56.617772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 17:33:56.630857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:56.632052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:33:56.633217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 479/957] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:56.638166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:56.745746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c6b01-1a96-4f26-9f43-bb08ceb56564 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.770799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:56.780299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.780911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.781218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.781490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:56.782211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:56.782537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:56.783960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:56.802102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 479/958] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Oct 17 17:33:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:56.808111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:56.825026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:56.922104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6767e-89ed-4699-b226-38f25b9bd887 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:56.960116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:56.960722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:56.960995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:56.961258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:57.044131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:57.045622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:57.063172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:57.157709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 480/959] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Oct 17 17:33:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 17:33:57.163941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:57.281889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ced34b-9860-4469-8dc5-4c267beadf43 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:57.322323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:57.322960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:57.323237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:57.323510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:57.335378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:57.337084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 17:33:57.353423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:57.355931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 17:33:57.359654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 17:33:57.359654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 17:33:57.359654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:57.359654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 480/960] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:57.365313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:57.478233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d093f-3592-43f4-84d8-fb5770e4240f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:57.492884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:57.518569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:57.519282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:57.519709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:57.520088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:57.520841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:57.521141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:57.522553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:57.534782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 481/961] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Oct 17 17:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:57.540947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:57.585756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:57.658799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe87e44-661d-4d3b-99e2-63ba39112141 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:57.699413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:57.700071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:57.700346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:57.700612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:57.708807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:57.710263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 17:33:57.722654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:33:57.724369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Oct 17 17:33:57.725623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 481/962] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Oct 17 17:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:33:57.730195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:57.847667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d742f-9c58-4c09-8616-ee1229d83c2e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:57.887325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:57.887944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:57.888503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:57.888775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:57.889516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:57.889845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:57.891318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fb19-5545-4d83-a0d3-f581929acfe9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:57.905891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 482/963] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Oct 17 17:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:33:57.912942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:33:58.044053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:33:58.050999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7bca-6379-456a-97ea-741ab80f612a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:33:58.094915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:33:58.095531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:33:58.095777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:33:58.096037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:33:58.096790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] RBAC: Adding query filter params (role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7, scope.project.id=42c02dd9a0e2458896aea742a1ec9a39, user.id=a8a289b1980346cc89cd56154b8c32fa) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:33:58.097123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:33:58.098791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24242-41f1-41b4-bdc6-a6275d778d05 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:33:58.105315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 482/964] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Oct 17 17:33:57 2022] GET /identity/v3/role_assignments?user.id=a8a289b1980346cc89cd56154b8c32fa&scope.project.id=42c02dd9a0e2458896aea742a1ec9a39&role.id=7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:00.280102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b66ed-afb1-4624-8964-7e00f025d560 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:00.280988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b66ed-afb1-4624-8964-7e00f025d560 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:00.280988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b66ed-afb1-4624-8964-7e00f025d560 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:00.283176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 483/965] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:34:00.291243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:00.291705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:00.291796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:00.311825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:34:00.312986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:34:00.403002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 483/966] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:34:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:34:00.675672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b66ed-afb1-4624-8964-7e00f025d560 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:00.719078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:00.798569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b66ed-afb1-4624-8964-7e00f025d560 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:00.834623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:00.835239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:00.835506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:00.835767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:00.836355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:00.837752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:34:00.847455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:34:00.848957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:00.849961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 484/967] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:34:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:34:00.855577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:00.960292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:00.971714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e94d1-712c-4f50-b8ef-535891552892 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:01.007752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:01.008343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:01.008612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:01.008874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:01.009497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:34:01.009828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:01.011161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842108e-d4ca-45df-a71a-a4883e1b9e15 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:01.016043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 484/968] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Oct 17 17:34:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:01.022566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:01.125356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:01.132459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e37b-5d79-43f0-9fca-5316df6b1136 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:01.170494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:01.171122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:01.171476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:01.171775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:01.172444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:34:01.172753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:01.174279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf571a-d255-403b-aaff-1d47f1755398 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:01.179295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 485/969] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Oct 17 17:34:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:03.346886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c6f1-be9a-44f3-90ca-f4e79ea3eaf6 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:03.347787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c6f1-be9a-44f3-90ca-f4e79ea3eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:03.347787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c6f1-be9a-44f3-90ca-f4e79ea3eaf6 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:03.350209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 485/970] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:34:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:34:03.356554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16059-829f-4e6f-9cfc-7115442d7d56 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:03.356993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16059-829f-4e6f-9cfc-7115442d7d56 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:03.357123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16059-829f-4e6f-9cfc-7115442d7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:03.379233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3bc16059-829f-4e6f-9cfc-7115442d7d56 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:34:03.380417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3bc16059-829f-4e6f-9cfc-7115442d7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:34:03.453869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 486/971] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:34:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:34:03.717618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c6f1-be9a-44f3-90ca-f4e79ea3eaf6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:03.836580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c6f1-be9a-44f3-90ca-f4e79ea3eaf6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:03.876574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:03.877157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:03.877481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:03.877849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:03.878520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:03.880251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961d44-af5f-492c-9d2e-150aed22798b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:03.897724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 486/972] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Oct 17 17:34:03 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:34:06.069553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805e71-f0a8-4b85-bcd6-6625c32cb77d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:06.070448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805e71-f0a8-4b85-bcd6-6625c32cb77d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:06.070448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805e71-f0a8-4b85-bcd6-6625c32cb77d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:06.072583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 487/973] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:34:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:34:06.081240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:06.081680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:06.082042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:06.107427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:34:06.108613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:34:06.118774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:06.193657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 487/974] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:34:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 17:34:06.456101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805e71-f0a8-4b85-bcd6-6625c32cb77d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:06.550990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:06.568158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805e71-f0a8-4b85-bcd6-6625c32cb77d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:06.604008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:06.604826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:06.605102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:06.605365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:06.605976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:06.607343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:34:06.617304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:34:06.618461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:06.619683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 488/975] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:34:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:34:06.627236 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:06.755043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5cc21-c847-4739-80f2-1e3ab18d404b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:06.789164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:06.789795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:06.790065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:06.790313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:06.790939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:34:06.791238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:06.792599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:06.798406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 488/976] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Oct 17 17:34:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:06.807155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:06.915857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d17b0-618e-45b4-a8cc-7e81d537d519 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:06.953224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943467bf-4728-4832-b295-258035cdc01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:06.953834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943467bf-4728-4832-b295-258035cdc01e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:06.954108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943467bf-4728-4832-b295-258035cdc01e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:06.954370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943467bf-4728-4832-b295-258035cdc01e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:06.955057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943467bf-4728-4832-b295-258035cdc01e None admin] RBAC: Adding query filter params (interface=public, service_id=a26477635e29471eac08a753e66da540, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:34:06.955362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943467bf-4728-4832-b295-258035cdc01e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:06.956706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943467bf-4728-4832-b295-258035cdc01e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:06.962446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 489/977] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Oct 17 17:34:06 2022] GET /identity/v3/endpoints?service_id=a26477635e29471eac08a753e66da540&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:06.969191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:06.975390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:07.086712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e8732-5c4f-426b-8b36-dd0e417c60f4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:07.121434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:07.122374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:07.122629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:07.122906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:07.123502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:07.124907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42ae54-107d-4291-a201-3c11d0cb8d78 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:07.132008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 489/978] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Oct 17 17:34:06 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:34:09.309942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2d71-1d79-49a7-89ec-16a87142c8a9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:09.310518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2d71-1d79-49a7-89ec-16a87142c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:09.310518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2d71-1d79-49a7-89ec-16a87142c8a9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:09.312560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 490/979] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:34:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:34:09.321061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:09.321502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:09.321609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:09.341491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:34:09.342712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:34:09.409044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:09.416638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 490/980] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:34:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 17:34:09.685560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2d71-1d79-49a7-89ec-16a87142c8a9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:09.711255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:09.804722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2d71-1d79-49a7-89ec-16a87142c8a9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:09.840105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:09.840730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:09.841006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:09.841269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:09.841883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:09.843242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 17:34:09.852075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 17:34:09.853208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Oct 17 17:34:09.854571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 491/981] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Oct 17 17:34:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 17:34:09.859876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:09.980590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c88bb-a3d8-472b-9504-094474ff656e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:10.017508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:10.018141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:10.018427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:10.018696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:10.019611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:34:10.020187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:10.021554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f8919-1837-4aef-9e51-4729ca0104ab None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:10.026883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 491/982] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Oct 17 17:34:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:34:10.035553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:34:10.124558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:10.149405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dc412-e8e0-41b5-94a7-af850a5cbfa5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:34:10.191569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:34:10.192491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:34:10.192844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:34:10.193208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:34:10.194221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:34:10.195937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6fe97-80ed-4324-9002-c9758f4a274f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:34:10.218829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 492/983] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:34:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:34:20.023674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=69 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:34:20.214453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:14.462832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9943f3-88d6-4db2-bc91-fd3c5b4439c4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:14.463329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9943f3-88d6-4db2-bc91-fd3c5b4439c4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:14.463417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9943f3-88d6-4db2-bc91-fd3c5b4439c4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:14.464769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 492/984] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:14.470649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2721ad-e589-43ab-b30f-26d9e6355721 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:14.471141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2721ad-e589-43ab-b30f-26d9e6355721 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:14.471262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2721ad-e589-43ab-b30f-26d9e6355721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:14.553782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fb2721ad-e589-43ab-b30f-26d9e6355721 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:14.554737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb2721ad-e589-43ab-b30f-26d9e6355721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:14.705840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 493/985] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:14.999785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:15.000655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:15.001145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:15.003022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 493/986] 10.222.0.62 () {54 vars in 964 bytes} [Mon Oct 17 17:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:15.009331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25ac7e-e400-4722-9608-052445c15345 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:15.009909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25ac7e-e400-4722-9608-052445c15345 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:15.010424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25ac7e-e400-4722-9608-052445c15345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:15.112671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bc25ac7e-e400-4722-9608-052445c15345 None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:15.114636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc25ac7e-e400-4722-9608-052445c15345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:15.141124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:15.208694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 494/987] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Oct 17 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:35:15.217861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:15.220042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:15.354340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15195-5fc1-476c-b573-802c77a49879 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:15.439907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:15.440862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:15.441344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:15.441817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:15.443689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:15.504898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:15.566116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:15.568514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff726c4-e7a5-4726-83d5-6a2a76e56ac0 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:15.588975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 494/988] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:18.109541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf5e1-2c1f-479f-8384-94ed2bb72209 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:18.110650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf5e1-2c1f-479f-8384-94ed2bb72209 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:18.110650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bf5e1-2c1f-479f-8384-94ed2bb72209 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:18.112751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 495/989] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:18.121991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0bdc-85d3-4e45-a2e9-460d68a0aeb8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:18.122426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0bdc-85d3-4e45-a2e9-460d68a0aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:18.122567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e0bdc-85d3-4e45-a2e9-460d68a0aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:18.211498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-110e0bdc-85d3-4e45-a2e9-460d68a0aeb8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:18.212711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-110e0bdc-85d3-4e45-a2e9-460d68a0aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:18.321962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 495/990] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:18.627274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:18.627571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:18.627827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:18.630546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 496/991] 10.222.0.62 () {54 vars in 964 bytes} [Mon Oct 17 17:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:18.637261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c379b08-fb0d-4cde-b7ee-0185a1939e0e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:18.637550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c379b08-fb0d-4cde-b7ee-0185a1939e0e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:18.637901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c379b08-fb0d-4cde-b7ee-0185a1939e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:18.653961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:18.740989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5c379b08-fb0d-4cde-b7ee-0185a1939e0e None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:18.742245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5c379b08-fb0d-4cde-b7ee-0185a1939e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:18.825467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 496/992] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Oct 17 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:18.835662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:18.837737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:18.956982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57b85-115c-49bc-8fab-afbfbc766c92 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:19.035470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:19.038190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:19.039104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:19.039590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:19.040100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:19.041776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:19.179210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:19.180658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248781-9f2f-497c-b6d3-996e006f3ab1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:19.201271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 497/993] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:21.930212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:21.930846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:21.930846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:21.932208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 497/994] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:21.938767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c91-9c02-4821-9a50-a1d765b8fa67 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:21.939416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c91-9c02-4821-9a50-a1d765b8fa67 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:21.939612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c91-9c02-4821-9a50-a1d765b8fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:22.025771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-01e92c91-9c02-4821-9a50-a1d765b8fa67 None None] MFA Rules not processed for user `df53393606f04e0f9cd00d0cc71d3e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:22.027321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-01e92c91-9c02-4821-9a50-a1d765b8fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:22.099878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:22.150973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 498/995] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:22.438392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:22.440085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:22.548785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b2a03-2e32-41e8-97aa-b70c81f9185d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:22.551792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:22.646692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:22.647301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:22.647574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:22.647843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:22.649451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:22.763925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:22.765272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641694c-de78-43d3-a7a3-cd27a9bf6116 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:22.785298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 498/996] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:35:25.505505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:25.506076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:25.506076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:25.507403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 499/997] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:25.512902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f897-2c60-4ec6-a76a-7ff700c68973 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:25.513334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f897-2c60-4ec6-a76a-7ff700c68973 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:25.513531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f897-2c60-4ec6-a76a-7ff700c68973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:25.557195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:25.587261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c887f897-2c60-4ec6-a76a-7ff700c68973 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:25.588483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c887f897-2c60-4ec6-a76a-7ff700c68973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:25.688529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 499/998] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:25.972362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:25.974919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:26.087855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930c6f8-3bba-41c8-8814-50be1f54386d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:26.176865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:26.177473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:26.177783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:26.178053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:26.179646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:26.186592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:26.294968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:26.296310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93134fdf-53b9-46a8-884a-71895bc980b5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:26.319619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 500/999] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:29.165921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:29.166563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:29.166563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:29.167800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 500/1000] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:29.174089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597429-f3ac-4623-8a72-b11ea4c35f25 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:29.174667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597429-f3ac-4623-8a72-b11ea4c35f25 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:29.174667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597429-f3ac-4623-8a72-b11ea4c35f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:29.252052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e7597429-f3ac-4623-8a72-b11ea4c35f25 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:29.253277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e7597429-f3ac-4623-8a72-b11ea4c35f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:29.318402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:29.361076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 501/1001] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:29.645987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:29.647607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:29.756607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6764d-1c3b-4863-95ea-0cbf7eb568c3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:29.770579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:29.835895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:29.836515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:29.836793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:29.837063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:29.838730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:29.953223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:29.954745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4ad8c-fde4-42bf-8678-59b4714eb874 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:29.973078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 501/1002] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:32.163072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:32.163708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:32.163708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:32.164977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 502/1003] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:32.170327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c58fe-7655-48a5-ae12-d9c84fe975ea None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:32.170788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c58fe-7655-48a5-ae12-d9c84fe975ea None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:32.170882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c58fe-7655-48a5-ae12-d9c84fe975ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:32.222326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:32.247478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-158c58fe-7655-48a5-ae12-d9c84fe975ea None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:32.248720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-158c58fe-7655-48a5-ae12-d9c84fe975ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:32.349784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 502/1004] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:32.631605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:32.633279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:32.739926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a8a9-5c70-4cfd-ae4e-c09cc972e05c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:32.818377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:32.818993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:32.819272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:32.819512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:32.821132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:32.839956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:32.937920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:32.939579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0fb0a-f8a6-4851-b23c-413368c31a20 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:32.959195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 503/1005] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:35.147711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:35.148287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:35.148287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:35.150162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 503/1006] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:35.158274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3b0d0-16e7-42a1-b83a-1e09310ad9e0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:35.158716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3b0d0-16e7-42a1-b83a-1e09310ad9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:35.158836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3b0d0-16e7-42a1-b83a-1e09310ad9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:35.236190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79d3b0d0-16e7-42a1-b83a-1e09310ad9e0 None None] MFA Rules not processed for user `df53393606f04e0f9cd00d0cc71d3e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:35.237448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79d3b0d0-16e7-42a1-b83a-1e09310ad9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:35.306746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:35.340224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 504/1007] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:35.631768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:35.633354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:35.746090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829e4b-a15f-488b-ad2c-32fecefc525a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:35.767573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:35.824788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:35.825420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:35.825717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:35.825987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:35.827609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:35.942117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:35.943478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb8f6-c30d-447b-b817-9e5a35ae53eb service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:35.962758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 504/1008] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:35:38.502517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:38.503041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:38.503041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:38.504412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 505/1009] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:38.510807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912f7-23ab-4a13-8e5a-c9f7f20f54a6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:38.511521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912f7-23ab-4a13-8e5a-c9f7f20f54a6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:38.511676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912f7-23ab-4a13-8e5a-c9f7f20f54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:38.580575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:38.583815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-676912f7-23ab-4a13-8e5a-c9f7f20f54a6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:38.585824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-676912f7-23ab-4a13-8e5a-c9f7f20f54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:38.690626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 505/1010] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:38.971050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:38.972607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:39.089400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71bf4-f1a2-4b12-bc25-ba2b61db5f40 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:39.175789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:39.176422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:39.176694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:39.176954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:39.178581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:39.207000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:39.298809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:39.300200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f671de-0df7-4ee2-8501-9121933c328e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:39.320357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 506/1011] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:41.523335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:41.523884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:41.523884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:41.526194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 506/1012] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:41.535318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037410d-8d88-4998-af7d-7842d46d2db1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:41.535713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037410d-8d88-4998-af7d-7842d46d2db1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:41.535952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037410d-8d88-4998-af7d-7842d46d2db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:41.612695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f037410d-8d88-4998-af7d-7842d46d2db1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:41.613938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f037410d-8d88-4998-af7d-7842d46d2db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:41.694273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:41.717778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 507/1013] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:42.007130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:42.008725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:42.124154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681a0bd-ac10-4b04-a60d-f14b219b6b8e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:42.155899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:42.204355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:42.204964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:42.205239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:42.205478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:42.207146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:42.326127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:42.327485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de211ee-cc7d-4921-83dc-8a5aea71428e service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:42.346725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 507/1014] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:44.992504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:44.993368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:44.993368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:44.995909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 508/1015] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:45.001609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021c37-d90d-4c3b-9357-558437f7232e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:45.002043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021c37-d90d-4c3b-9357-558437f7232e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:45.002172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021c37-d90d-4c3b-9357-558437f7232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:45.070279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-01021c37-d90d-4c3b-9357-558437f7232e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:45.071490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-01021c37-d90d-4c3b-9357-558437f7232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:45.080275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:45.183042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 508/1016] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:45.474655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:45.477087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:45.595308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d069cc3-463b-4110-b849-4f149872fe90 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:45.676480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:45.677097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:45.677374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:45.677673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:45.679329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:45.724442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:45.816621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:45.818098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d761d-11ef-4883-8fd0-eef4ae83b5c3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:45.837542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 509/1017] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:50.040057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:50.040594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:50.040594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:50.041967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 509/1018] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:50.047845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f127c-c94c-451b-a270-317141c7174d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:50.048266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f127c-c94c-451b-a270-317141c7174d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:50.048354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f127c-c94c-451b-a270-317141c7174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:50.119263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fa8f127c-c94c-451b-a270-317141c7174d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:50.120808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa8f127c-c94c-451b-a270-317141c7174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:50.213984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:50.226570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 510/1019] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:50.504924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:50.507084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:50.614984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd25f-c183-45ab-acdc-168acda5f0e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:50.655487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:50.694383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:50.694994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:50.695240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:50.695534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:50.697130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:50.814158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:50.815507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072064a-2bac-4b2a-8362-404f77d6fd55 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:50.835743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 510/1020] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:53.599021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:53.599557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:53.599645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:53.601002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 511/1021] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:53.606358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27036-4501-4794-9585-792bd3678c31 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:53.606807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27036-4501-4794-9585-792bd3678c31 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:53.606893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27036-4501-4794-9585-792bd3678c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:53.677386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-06e27036-4501-4794-9585-792bd3678c31 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:53.678624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-06e27036-4501-4794-9585-792bd3678c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:53.697847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:53.785892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 511/1022] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:35:54.075052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:54.076605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:54.200247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34b12-ee48-4b88-8ee4-f0919d19c1d0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:54.277011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:54.277524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:54.277827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:54.278097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:54.279693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:54.325256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:54.397849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:54.399318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac707ef-8c53-48e1-aaf4-725982452da7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:54.418213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 512/1023] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:35:58.862140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:58.862776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:58.862877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:58.865104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 512/1024] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:35:58.871016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149b0b-ff79-480e-9dd3-9edb9a805fd8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:58.871444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149b0b-ff79-480e-9dd3-9edb9a805fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:58.871581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149b0b-ff79-480e-9dd3-9edb9a805fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:58.943207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c1149b0b-ff79-480e-9dd3-9edb9a805fd8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:35:58.944487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c1149b0b-ff79-480e-9dd3-9edb9a805fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:59.044387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:59.046654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 513/1025] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:35:59.331572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:35:59.334062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:59.455014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad90be-8ae2-40f4-967b-1e31387dbf14 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:35:59.511130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:35:59.542159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:35:59.542788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:35:59.543071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:35:59.543341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:35:59.545055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:35:59.686168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:35:59.687624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eabc97-833e-49e1-9e67-3a3afc8ba48e service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:35:59.707483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 513/1026] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:04.821140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fd76-d4ea-420d-bb7c-68c4912de81d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:04.821740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fd76-d4ea-420d-bb7c-68c4912de81d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:04.821740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fd76-d4ea-420d-bb7c-68c4912de81d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:04.824973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 514/1027] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:04.830586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33f87-1235-4626-95cd-3604249fd847 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:04.830586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33f87-1235-4626-95cd-3604249fd847 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:04.830586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33f87-1235-4626-95cd-3604249fd847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:04.926594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-13f33f87-1235-4626-95cd-3604249fd847 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:04.928368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-13f33f87-1235-4626-95cd-3604249fd847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:04.969963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:05.083841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 514/1028] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:36:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:09.147710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28203b7-1c8e-4930-85fc-b0d5baa78d2a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:09.148301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28203b7-1c8e-4930-85fc-b0d5baa78d2a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:09.148301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28203b7-1c8e-4930-85fc-b0d5baa78d2a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:09.149777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 515/1029] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:09.155339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaed200-a1d8-4154-a3e0-417875f76952 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:09.155803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaed200-a1d8-4154-a3e0-417875f76952 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:09.156093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaed200-a1d8-4154-a3e0-417875f76952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:09.243874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ebaed200-a1d8-4154-a3e0-417875f76952 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:09.245594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ebaed200-a1d8-4154-a3e0-417875f76952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:09.327799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:09.368452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 515/1030] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:36:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:10.832784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04bf27-b2f7-4eec-9173-5dc889b781d6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:10.833309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04bf27-b2f7-4eec-9173-5dc889b781d6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:10.833309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04bf27-b2f7-4eec-9173-5dc889b781d6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:10.834588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 516/1031] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:10.839637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b260-40d7-4185-a426-825cbdbae44f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:10.840090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b260-40d7-4185-a426-825cbdbae44f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:10.840183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b260-40d7-4185-a426-825cbdbae44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:10.921489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-85d7b260-40d7-4185-a426-825cbdbae44f None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:10.922737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-85d7b260-40d7-4185-a426-825cbdbae44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:11.037934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 516/1032] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:14.657599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d5191-cb93-4ea5-af97-43bc12627445 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:14.658244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d5191-cb93-4ea5-af97-43bc12627445 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:14.658446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d5191-cb93-4ea5-af97-43bc12627445 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:14.660201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 517/1033] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:14.665874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dfb-8a96-4639-add5-54d6ee103e59 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:14.666297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dfb-8a96-4639-add5-54d6ee103e59 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:14.666399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dfb-8a96-4639-add5-54d6ee103e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:14.706918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:14.739436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fe3a4dfb-8a96-4639-add5-54d6ee103e59 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:14.740734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fe3a4dfb-8a96-4639-add5-54d6ee103e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:14.846392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 517/1034] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:15.151750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:15.152153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:15.152647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:15.154153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 518/1035] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:15.160763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d20f-c4ca-489e-ae1c-cefb36925780 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:15.161170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d20f-c4ca-489e-ae1c-cefb36925780 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:15.161540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726d20f-c4ca-489e-ae1c-cefb36925780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:15.256507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f726d20f-c4ca-489e-ae1c-cefb36925780 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:15.258341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f726d20f-c4ca-489e-ae1c-cefb36925780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:15.325086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:15.407310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 518/1036] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:36:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:15.415861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:15.417771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:15.620251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95edeb-bc06-44b6-8d83-d0acad644973 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:15.727127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:15.773753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:15.774400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:15.774676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:15.774956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:15.776569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:15.876270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:15.877928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf44da5-a9f2-4835-9fee-cc1004a6ed5a service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:15.896733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 519/1037] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:18.307622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:18.308205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:18.308205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:18.311897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 519/1038] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:18.315497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e900-d5eb-4df8-8762-cbdc8a894cb9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:18.315974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e900-d5eb-4df8-8762-cbdc8a894cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:18.316072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e900-d5eb-4df8-8762-cbdc8a894cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:18.389498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3db3e900-d5eb-4df8-8762-cbdc8a894cb9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:18.390828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3db3e900-d5eb-4df8-8762-cbdc8a894cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:18.433189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:18.505624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 520/1039] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:18.797369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:18.799717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:18.972026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f333fca-0b4f-47c7-a84c-80e96eb4889c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:18.981665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:19.092770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:19.093396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:19.093729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:19.093997 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:19.096294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:19.193887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:19.195500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e093-5bfb-4c1a-9bfc-db8889655412 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:19.214311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 520/1040] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:21.714999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc6ad3-a7f6-4816-bee2-9a628ade4abb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:21.715558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc6ad3-a7f6-4816-bee2-9a628ade4abb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:21.715558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc6ad3-a7f6-4816-bee2-9a628ade4abb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:21.717054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 521/1041] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:21.722849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81b0a-b40a-4e19-90bb-63159aa0e484 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:21.723315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81b0a-b40a-4e19-90bb-63159aa0e484 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:21.723397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81b0a-b40a-4e19-90bb-63159aa0e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:21.740678 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:21.797762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bdd81b0a-b40a-4e19-90bb-63159aa0e484 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:21.799046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bdd81b0a-b40a-4e19-90bb-63159aa0e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:21.904342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 521/1042] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:22.195474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:22.195753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:22.196017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:22.197652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 522/1043] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:22.203337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c63c5-5326-4680-8c9a-b5ce5a6c66c3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:22.203626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c63c5-5326-4680-8c9a-b5ce5a6c66c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:22.203897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c63c5-5326-4680-8c9a-b5ce5a6c66c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:22.287072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-169c63c5-5326-4680-8c9a-b5ce5a6c66c3 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:22.288198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-169c63c5-5326-4680-8c9a-b5ce5a6c66c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:22.325144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:22.415282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 522/1044] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:36:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:22.424948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:22.426611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:22.601533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce9fe-5eee-41f4-a58a-a08ef3aecf76 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:22.625771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:22.707229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e28-2abd-4f6a-8f0e-dd7cf4c97c10 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:22.707574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e28-2abd-4f6a-8f0e-dd7cf4c97c10 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:22.707766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e28-2abd-4f6a-8f0e-dd7cf4c97c10 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:22.709373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 523/1045] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:36:22.714630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463120f-75f6-4b5a-b947-ad830ffb0d59 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:22.714880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463120f-75f6-4b5a-b947-ad830ffb0d59 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:22.715150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463120f-75f6-4b5a-b947-ad830ffb0d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:22.730635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:22.731366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:22.731533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:22.731804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:22.733425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:22.787267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0463120f-75f6-4b5a-b947-ad830ffb0d59 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:22.788491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0463120f-75f6-4b5a-b947-ad830ffb0d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:22.838685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:22.840311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db24375-e14f-44f8-a82b-57c0f8233ff3 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:22.862033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 523/1046] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:22.898112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:22.910266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 524/1047] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:23.244693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:23.244989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:23.245252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:23.246710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 524/1048] 10.222.0.62 () {54 vars in 963 bytes} [Mon Oct 17 17:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:23.252060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1ba4-ab7e-4851-8f22-1f61993abe58 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:23.252559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1ba4-ab7e-4851-8f22-1f61993abe58 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:23.252839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1ba4-ab7e-4851-8f22-1f61993abe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:23.334906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1dad1ba4-ab7e-4851-8f22-1f61993abe58 None None] MFA Rules not processed for user `cb97ad1bfae943289b1b967065937396`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:23.336119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1dad1ba4-ab7e-4851-8f22-1f61993abe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:23.420694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 525/1049] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Oct 17 17:36:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:23.431496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:23.433065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:23.464438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:23.548326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a150b-3cec-4d81-b572-f9ec5c58849b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:23.634370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:23.634370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:23.634370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:23.634370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:23.635338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:23.740229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:23.789603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:23.791078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a1dc1-f474-4037-b8fd-c2c3eef21451 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:23.811626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 525/1050] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:25.102100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:25.102701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:25.102701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:25.103980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 526/1051] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:25.109696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24547da-c63d-4742-b9d7-0a3f164ca813 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:25.110152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24547da-c63d-4742-b9d7-0a3f164ca813 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:25.110230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24547da-c63d-4742-b9d7-0a3f164ca813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:25.182684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b24547da-c63d-4742-b9d7-0a3f164ca813 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:25.183933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b24547da-c63d-4742-b9d7-0a3f164ca813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:25.291438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 526/1052] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:25.580869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:25.582610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:25.702084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:25.774420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b485-74f2-4425-9bab-cbae52f3edcd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:25.917390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:25.917986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:25.918264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:25.918567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:25.920200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:25.975665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:26.022751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:26.024590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6efb-c23f-45cc-9729-e240d00e7b0c service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:26.045422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 527/1053] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:36:28.289761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:28.290286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:28.290286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:28.291580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 527/1054] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:28.297172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe708-6508-418d-9aac-752a9063103a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:28.297634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe708-6508-418d-9aac-752a9063103a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:28.297807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe708-6508-418d-9aac-752a9063103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:28.367069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7dbbe708-6508-418d-9aac-752a9063103a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:28.368270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7dbbe708-6508-418d-9aac-752a9063103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:28.471394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 528/1055] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:28.766578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:28.768339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:28.809630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:28.924482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aab706-41a3-48f8-bbc9-2581f195aa7d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:29.042005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:29.048511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:29.049221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:29.049606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:29.049971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:29.051666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:29.145715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:29.147462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1131-aa39-4f77-b2c3-7b57da5d8d78 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:29.168090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 528/1056] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:31.411035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:31.411679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:31.411679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:31.412961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 529/1057] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:31.418656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea38c-c1c0-487a-a960-f549f713b0c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:31.419224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea38c-c1c0-487a-a960-f549f713b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:31.419224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea38c-c1c0-487a-a960-f549f713b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:31.490559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-538ea38c-c1c0-487a-a960-f549f713b0c2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:31.491770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-538ea38c-c1c0-487a-a960-f549f713b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:31.566085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:31.601132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 529/1058] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:31.896644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:31.898220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:31.928295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:32.079077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c031-f122-4b5d-8bf8-0351bf3410a5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:32.211504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:32.236303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:32.237040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:32.237403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:32.237730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:32.240226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:32.352362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:32.354252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce95171-57fc-41e4-9385-a7ee24fa05df service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:32.377201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 530/1059] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:36:34.648154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:34.648700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:34.648700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:34.650118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 530/1060] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:34.656766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65a2c-6441-4487-b9bf-cca8d4b74ed0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:34.657249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65a2c-6441-4487-b9bf-cca8d4b74ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:34.658097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65a2c-6441-4487-b9bf-cca8d4b74ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:34.740920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-35a65a2c-6441-4487-b9bf-cca8d4b74ed0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:34.742090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-35a65a2c-6441-4487-b9bf-cca8d4b74ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:34.802325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:34.847496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 531/1061] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:35.152837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:35.154814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:35.314642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ac5c-9d80-47a3-a975-2324dc7ebd6e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:35.372218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:35.437107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:35.437736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:35.438020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:35.438450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:35.440246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:35.543003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:35.544729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d939f78-14df-4fa6-bbca-f9e63aff1f40 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:35.563909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 531/1062] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:37.804453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:37.805095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:37.805475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:37.808578 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 532/1063] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:36:37.816235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d72d-d407-4ea5-b9f5-ed5dc988feff None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:37.817020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d72d-d407-4ea5-b9f5-ed5dc988feff None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:37.817336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d72d-d407-4ea5-b9f5-ed5dc988feff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:37.893921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4708d72d-d407-4ea5-b9f5-ed5dc988feff None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:37.895198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4708d72d-d407-4ea5-b9f5-ed5dc988feff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:37.904423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:38.005997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 532/1064] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:38.305712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:38.308754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:38.500775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54205ffa-ecda-402d-abf1-d219cca38e8f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:38.559416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:38.632917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:38.633566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:38.633895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:38.634162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:38.635746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:38.733773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:38.735540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cbbc3-0ba6-4224-8e0d-39ca093a70dd service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:38.754443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 533/1065] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:40.651314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb0b-c6eb-4d91-b2bb-88b1696e9da8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:40.651914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb0b-c6eb-4d91-b2bb-88b1696e9da8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:40.651914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fb0b-c6eb-4d91-b2bb-88b1696e9da8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:40.653231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 533/1066] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:40.658756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2184f-2f44-4e45-b0e8-2a6076ca00c2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:40.659246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2184f-2f44-4e45-b0e8-2a6076ca00c2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:40.659246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2184f-2f44-4e45-b0e8-2a6076ca00c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:40.723118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:40.725699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-17c2184f-2f44-4e45-b0e8-2a6076ca00c2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:40.727296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-17c2184f-2f44-4e45-b0e8-2a6076ca00c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:40.826291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 534/1067] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:40.950756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67069eb7-fd89-4fc8-b135-cc7c9fb8786f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:40.951010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67069eb7-fd89-4fc8-b135-cc7c9fb8786f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:40.951297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67069eb7-fd89-4fc8-b135-cc7c9fb8786f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:40.952655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 534/1068] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:40.959872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:40.960158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:40.960429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:41.030705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:41.031863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.113363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:41.128177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe433-46a1-4993-a56d-c82a4b603e62 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:41.128457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe433-46a1-4993-a56d-c82a4b603e62 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:41.128750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe433-46a1-4993-a56d-c82a4b603e62 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:41.130429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 535/1069] 10.222.0.62 () {54 vars in 962 bytes} [Mon Oct 17 17:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:41.137007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:41.137276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 535/1070] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:41.137435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:41.137656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:41.221920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] MFA Rules not processed for user `ea10fd96c9fa48809e2dfa85b11d8d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:41.223140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.305691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 536/1071] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Oct 17 17:36:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:41.315418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:41.316626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.409739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0b799-f030-4842-a4d8-79e75b5f2407 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:41.423425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:41.424746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.430071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:41.489712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:41.490332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:41.490608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:41.490878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:41.492489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.545737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:41.556531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e71dff-4033-45ca-aeda-361ccb8a303c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:41.611637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:41.613078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87e02d-9706-4f29-8e26-0bcc1da06e87 service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:41.632689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 536/1072] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:41.666880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:41.672724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:41.673331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:41.673599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:41.673889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:41.675473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:41.770295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:41.771891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeed95-6ec7-46b8-ac9a-baca5a836daa service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:41.790216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 537/1073] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:42.406543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6014d4-97a8-4380-91eb-9e9b03514051 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:42.407304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6014d4-97a8-4380-91eb-9e9b03514051 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:42.407304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6014d4-97a8-4380-91eb-9e9b03514051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:42.475076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fb6014d4-97a8-4380-91eb-9e9b03514051 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:42.476283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fb6014d4-97a8-4380-91eb-9e9b03514051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:42.564946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 537/1074] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:36:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:42.606940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:42.607326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:42.607677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:42.609177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 538/1075] 10.222.0.62 () {54 vars in 943 bytes} [Mon Oct 17 17:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:42.615945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303993-4a20-43c9-8e2e-cb442fecf242 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:42.616229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303993-4a20-43c9-8e2e-cb442fecf242 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:42.616495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de303993-4a20-43c9-8e2e-cb442fecf242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:42.638164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:42.694663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-de303993-4a20-43c9-8e2e-cb442fecf242 None None] MFA Rules not processed for user `e33fc4dc7ed74e7bb07e5746aa17e254`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:42.695787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-de303993-4a20-43c9-8e2e-cb442fecf242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:42.810260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 538/1076] 10.222.0.62 () {58 vars in 1040 bytes} [Mon Oct 17 17:36:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:42.820383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:42.821956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:42.946730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:42.964001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703c95-fde8-40e8-a10a-55afc013f056 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:43.071620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:43.072225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:43.072498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:43.072764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:43.074430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:43.158492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:43.160100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475a44-bf8d-418a-991d-a9af6570baea service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:43.168143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 539/1077] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:36:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:36:44.007882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:44.008468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:44.008468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:44.014040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 539/1078] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:44.015633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da018d-d2af-497e-9adc-a24e55b21350 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:44.016142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da018d-d2af-497e-9adc-a24e55b21350 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:44.016272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da018d-d2af-497e-9adc-a24e55b21350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:44.041656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:44.091855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c5da018d-d2af-497e-9adc-a24e55b21350 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:44.093079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c5da018d-d2af-497e-9adc-a24e55b21350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:44.200028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 540/1079] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:44.494328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:44.495607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:44.579814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:44.678193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b397a9-eed6-41a1-ae44-2b0276e13e5b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:44.826980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:44.827518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:44.827796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:44.828067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:44.829934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:44.874215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:44.998964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:45.000901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058495-d827-409a-8648-365eb8d3526f service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:45.023113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 540/1080] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:47.317926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:47.318507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:47.318507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:47.319956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 541/1081] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:47.325219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac4d8-6af5-4619-ac48-212632c64471 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:47.326086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac4d8-6af5-4619-ac48-212632c64471 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:47.326366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac4d8-6af5-4619-ac48-212632c64471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:47.404285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9d1ac4d8-6af5-4619-ac48-212632c64471 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:47.405900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9d1ac4d8-6af5-4619-ac48-212632c64471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:47.519227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 541/1082] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:36:47.813868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:47.815463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:47.919265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:47.979012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638b859-26d7-4a73-91b1-41ea30be6522 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:48.110319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:48.111135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:48.111417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:48.111693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:48.113343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:48.186314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:48.221118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:48.222762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474e4d-0ffd-40a7-b2ad-93f93cf09fa3 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:48.245704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 542/1083] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:36:50.490224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:50.490768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:50.490768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:50.492135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 542/1084] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:36:50.498058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83180e-3af8-4f42-8f0b-99564dfd51c6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:50.498514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83180e-3af8-4f42-8f0b-99564dfd51c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:50.498613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83180e-3af8-4f42-8f0b-99564dfd51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:50.573363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3b83180e-3af8-4f42-8f0b-99564dfd51c6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:36:50.575225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b83180e-3af8-4f42-8f0b-99564dfd51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:50.681198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 543/1085] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:36:50.960447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:36:50.962004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:50.976913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:51.121041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cf3d5-08a7-457a-ac06-efb8ac0fd8d1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:36:51.216761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:36:51.245877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:36:51.246648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:36:51.246931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:36:51.247230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:36:51.249169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:36:51.351066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:36:51.352661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ddbac-92de-4817-91e2-3ac81d4b8ac6 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:36:51.372316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 543/1086] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:00.677085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:01.369948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=56 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:06.082187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002c27-b54a-4631-81c1-ba6a3955be66 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:06.082866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002c27-b54a-4631-81c1-ba6a3955be66 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:06.082866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002c27-b54a-4631-81c1-ba6a3955be66 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:06.084311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 544/1087] 10.222.0.62 () {54 vars in 918 bytes} [Mon Oct 17 17:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:06.089752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e22c-6acc-4cd9-b46a-de2739ca06c4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:06.090192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e22c-6acc-4cd9-b46a-de2739ca06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:06.090318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e22c-6acc-4cd9-b46a-de2739ca06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:06.172039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1266e22c-6acc-4cd9-b46a-de2739ca06c4 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:06.173249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1266e22c-6acc-4cd9-b46a-de2739ca06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:06.297238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 544/1088] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Oct 17 17:37:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:06.312269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa087-a671-454f-be44-579bfde9ced4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:06.312548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa087-a671-454f-be44-579bfde9ced4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:06.312822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa087-a671-454f-be44-579bfde9ced4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:06.314225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 545/1089] 10.222.0.62 () {54 vars in 918 bytes} [Mon Oct 17 17:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:06.319306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2457-8e63-43e4-a32f-4c6eb0bd1257 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:06.319593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2457-8e63-43e4-a32f-4c6eb0bd1257 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:06.319891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2457-8e63-43e4-a32f-4c6eb0bd1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:06.395107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:06.399861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fc5f2457-8e63-43e4-a32f-4c6eb0bd1257 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:06.401033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fc5f2457-8e63-43e4-a32f-4c6eb0bd1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:06.524262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 545/1090] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Oct 17 17:37:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:09.105408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:09.106025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:09.106025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:09.107343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 546/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:09.114011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ed8-d3af-4ef3-b7f9-e1c90bc72f69 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:09.114724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ed8-d3af-4ef3-b7f9-e1c90bc72f69 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:09.115040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ed8-d3af-4ef3-b7f9-e1c90bc72f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:09.186565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ae978ed8-d3af-4ef3-b7f9-e1c90bc72f69 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:09.187785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ae978ed8-d3af-4ef3-b7f9-e1c90bc72f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:09.245269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:09.297893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 546/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:09.588347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:09.590809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:09.754666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6343c-764f-4139-acd5-f89ff37f45be None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:09.835235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:09.877774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:09.878382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:09.878656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:09.878927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:09.880652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:09.975554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:09.977159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decbe32-1342-4c77-b3a3-4228cfd708a0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:09.999476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 547/1093] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:11.163897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:11.164513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:11.164513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:11.165850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 547/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:11.172445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc291f-0cae-4ece-8f65-2513ad569d47 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:11.172919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc291f-0cae-4ece-8f65-2513ad569d47 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:11.173021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc291f-0cae-4ece-8f65-2513ad569d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:11.256995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1cfc291f-0cae-4ece-8f65-2513ad569d47 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:11.258253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1cfc291f-0cae-4ece-8f65-2513ad569d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:11.286446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:11.361722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 548/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:11.529033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:11.530596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:11.699237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d324-4a20-4637-85bf-2025a0480c41 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:11.744362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:11.824167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:11.824771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:11.825040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:11.825299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:11.826916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:11.921988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:11.923580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32d09-8ed8-4d96-80a2-8764c3b02d90 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:11.942659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 548/1096] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:13.090356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:13.091263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:13.091263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:13.093502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 549/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:13.102937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b7d8-62bd-4a82-b30e-d03fd328be8d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:13.103361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b7d8-62bd-4a82-b30e-d03fd328be8d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:13.103361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b7d8-62bd-4a82-b30e-d03fd328be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:13.168677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:13.192288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a154b7d8-62bd-4a82-b30e-d03fd328be8d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:13.193493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a154b7d8-62bd-4a82-b30e-d03fd328be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:13.299368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 549/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:13.458842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:13.460376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:13.612483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b58e1-7b7e-4ae8-8c00-36da8724794f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:13.626181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:13.752244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:13.752769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:13.753049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:13.753342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:13.755089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:13.860188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:13.861848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368afa9-9517-4ea2-a9f7-b48da878d451 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:13.882922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 550/1099] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:15.003864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:15.004929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:15.004929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:15.005934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 550/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:15.012630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a0b7-6db9-4fdc-b737-12ecf5b5f2c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:15.013091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a0b7-6db9-4fdc-b737-12ecf5b5f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:15.013193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a0b7-6db9-4fdc-b737-12ecf5b5f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:15.034654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:15.093551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2148a0b7-6db9-4fdc-b737-12ecf5b5f2c3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:15.094822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2148a0b7-6db9-4fdc-b737-12ecf5b5f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:15.201036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 551/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:15.352341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:15.353861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:15.480521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:15.518828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6d0df-63e7-4421-af10-8e824491874f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:15.637462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:15.638091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:15.638362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:15.638623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:15.640217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:15.723753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:15.743531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:15.745169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3c384-fdbf-4c45-ac00-5e552e3580c9 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:15.764033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 551/1102] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:16.897377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:16.897961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:16.897961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:16.899301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 552/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:16.906723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aece38-09d9-4e34-931c-dff5960146d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:16.907470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aece38-09d9-4e34-931c-dff5960146d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:16.907652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aece38-09d9-4e34-931c-dff5960146d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:16.988787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-49aece38-09d9-4e34-931c-dff5960146d8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:16.990051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49aece38-09d9-4e34-931c-dff5960146d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:17.098027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 552/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:17.265000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:17.267223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:17.364611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:17.442197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c32306-f7fb-48a0-973d-411e48998bd0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:17.571272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:17.571789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:17.572066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:17.572335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:17.573980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:17.627630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:17.671243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:17.672846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35f5b-2ecf-4aa3-8070-a30c20ccd0c2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:17.692236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 553/1105] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:18.762168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:18.762723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:18.762723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:18.764753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 553/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:18.771467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52e25-908f-4cd0-ae3d-c9dadb1c64a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:18.771983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52e25-908f-4cd0-ae3d-c9dadb1c64a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:18.772086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52e25-908f-4cd0-ae3d-c9dadb1c64a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:18.860648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-40c52e25-908f-4cd0-ae3d-c9dadb1c64a1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:18.861884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-40c52e25-908f-4cd0-ae3d-c9dadb1c64a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:18.974192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 554/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:19.132049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:19.133623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:19.185526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:19.298766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91a054-df76-482a-9a9f-f38de6735020 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:19.414613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:19.415147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:19.415425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:19.415692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:19.417334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:19.425059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:19.516625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:19.518269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f032e-b5d3-483b-a7c5-b1571f4d3d1e service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:19.536823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 554/1108] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:20.620119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:20.621306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:20.621603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:20.623053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 555/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:20.630022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f694c-bca5-47e4-be4f-252bc97038b2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:20.630453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f694c-bca5-47e4-be4f-252bc97038b2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:20.630567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f694c-bca5-47e4-be4f-252bc97038b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:20.710114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5f0f694c-bca5-47e4-be4f-252bc97038b2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:20.711227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f0f694c-bca5-47e4-be4f-252bc97038b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:20.786123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:20.815656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 555/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:20.970199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:20.972508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:20.998162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:21.165251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440b6c-da5a-4851-8e0e-b80113fa0ee0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:21.265787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:21.294835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:21.295453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:21.295729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:21.296000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:21.297678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:21.400798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:21.402563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b4ae-209e-4ddb-9bbe-1a92e7de1626 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:21.428178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 556/1111] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:22.491279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:22.491786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:22.491786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:22.493846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 556/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:22.500499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab4e-27d9-405e-a859-d9b3245f74e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:22.500981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab4e-27d9-405e-a859-d9b3245f74e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:22.501082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab4e-27d9-405e-a859-d9b3245f74e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:22.588821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5032ab4e-27d9-405e-a859-d9b3245f74e4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:22.590089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5032ab4e-27d9-405e-a859-d9b3245f74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:22.638234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:22.703588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 557/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:22.863228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:22.865628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:23.025971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bbcaa-8ac2-4ad8-88b3-6c8b55e7e3e4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:23.081677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:23.148197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:23.148896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:23.149172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:23.149446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:23.151133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:23.250658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:23.252255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c2440-cd0a-49c6-9038-768ee463e68a service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:23.271278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 557/1114] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:24.329699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:24.330252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:24.330252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:24.331526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 558/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:24.339209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3df187-1765-48d7-95d7-3d86c73a6fc4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:24.339915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3df187-1765-48d7-95d7-3d86c73a6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:24.340059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3df187-1765-48d7-95d7-3d86c73a6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:24.424400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7d3df187-1765-48d7-95d7-3d86c73a6fc4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:24.425616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7d3df187-1765-48d7-95d7-3d86c73a6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:24.427662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:24.529187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 558/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:24.690736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:24.701425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:24.853041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23880bc-5f4c-4e16-979a-2bb5d91b02a6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:24.888288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:24.981210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:24.981866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:24.982140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:24.982404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:24.984003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:25.089041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:25.090698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ff82-2f84-4e92-b1d3-778ee5adb5e2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:25.108780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 559/1117] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:27.185424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:27.186427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:27.186427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:27.188513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 559/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:27.194441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4303e-f2a3-45d6-8e3e-8aeba43e5d07 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:27.194893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4303e-f2a3-45d6-8e3e-8aeba43e5d07 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:27.194995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4303e-f2a3-45d6-8e3e-8aeba43e5d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:27.238379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:27.266125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-60b4303e-f2a3-45d6-8e3e-8aeba43e5d07 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:27.267329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60b4303e-f2a3-45d6-8e3e-8aeba43e5d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:27.374881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 560/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:27.658031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:27.659573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:27.767108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380b15-50d6-4911-b928-7acde3e60aa3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:27.801133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:27.844805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:27.845646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:27.846050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:27.846407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:27.849021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:27.971195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:27.972642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133dead-8c46-4554-93e2-81a035eb518b service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:27.993190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 560/1120] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:30.296683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:30.297263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:30.297263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:30.298613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 561/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:30.305386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72fd-d796-4560-91a1-28f20067940c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:30.306161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72fd-d796-4560-91a1-28f20067940c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:30.306549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72fd-d796-4560-91a1-28f20067940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:30.391512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5f9f72fd-d796-4560-91a1-28f20067940c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:30.392747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f9f72fd-d796-4560-91a1-28f20067940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:30.407002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:30.497394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 561/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:30.800143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:30.802649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:30.920652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9287-3007-4d2f-a641-fd0131629cf1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:30.935283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:31.018804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:31.019417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:31.019694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:31.019963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:31.021565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:31.144306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:31.146177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0effd-792b-46dc-9681-860eaec98a9c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:31.173530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 562/1123] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:33.661257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:33.661901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:33.661901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:33.663198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 562/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:33.669768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6177335-1575-445a-a553-77c2179985ac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:33.670224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6177335-1575-445a-a553-77c2179985ac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:33.670392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6177335-1575-445a-a553-77c2179985ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:33.727644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:33.746324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b6177335-1575-445a-a553-77c2179985ac None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:33.747546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b6177335-1575-445a-a553-77c2179985ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:33.868556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 563/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:34.155689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:34.158257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:34.281600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a836b6f-2560-4671-83bb-ca9a61974278 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:34.324081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:34.358511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:34.359112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:34.359385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:34.359646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:34.361230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:34.485270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:34.487539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b4ef0-2cf8-489d-b9af-e4f800b9ac98 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:34.508532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 563/1126] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:37:36.853814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:36.854350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:36.854350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:36.855678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 564/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:36.861705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80325b-637e-4c21-93ca-44464b2cdd9b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:36.862158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80325b-637e-4c21-93ca-44464b2cdd9b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:36.862261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80325b-637e-4c21-93ca-44464b2cdd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:36.931040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9d80325b-637e-4c21-93ca-44464b2cdd9b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:36.932273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9d80325b-637e-4c21-93ca-44464b2cdd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:36.954826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:37.047861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 564/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:37:37.332282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:37.334955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:37.452008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065788a-a6d0-4bbb-bf2f-61eb14767dc3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:37.474234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:37.529867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:37.530479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:37.530756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:37.531023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:37.532631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:37.656148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:37.657629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf6b8-1511-4259-aef6-f91fec20d2bd service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:37.676701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 565/1129] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:39.872890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:39.873788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:39.873788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:39.876012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 565/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:39.881738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249425f-83ca-4f43-98c2-1e98b0d1ca15 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:39.882171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249425f-83ca-4f43-98c2-1e98b0d1ca15 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:39.882263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249425f-83ca-4f43-98c2-1e98b0d1ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:39.949021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:39.952230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a249425f-83ca-4f43-98c2-1e98b0d1ca15 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:39.954124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a249425f-83ca-4f43-98c2-1e98b0d1ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:40.059132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 566/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:40.347428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:40.348991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:40.469880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4b37-fe89-4114-9bed-ad00e59b58d9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:40.522413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:40.547816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:40.548425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:40.548700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:40.548969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:40.550617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:40.669208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:40.671451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a115a6c-f381-45f1-88f3-cb5f7f93013c service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:40.693595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 566/1132] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:37:42.898370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:42.899051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:42.899051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:42.900440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 567/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:42.906658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110450-a40b-4829-8540-27b9e2c2cce0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:42.907140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110450-a40b-4829-8540-27b9e2c2cce0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:42.907249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110450-a40b-4829-8540-27b9e2c2cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:42.993383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f4110450-a40b-4829-8540-27b9e2c2cce0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:42.994662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f4110450-a40b-4829-8540-27b9e2c2cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:43.029862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:43.113025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 567/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:43.423539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:43.426075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:43.540325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c0270-e231-4317-a993-3265d12771c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:43.568933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:43.618524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:43.619138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:43.619418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:43.619691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:43.621299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:43.738614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:43.739982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84395-9e32-4549-b06c-8e4a3d3e52d7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:43.758940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 568/1135] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:45.981254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:45.982170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:45.982170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:45.984410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:45.992788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886c675-90fd-43cc-9c12-7a594bc8359d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:45.993571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886c675-90fd-43cc-9c12-7a594bc8359d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:45.993687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886c675-90fd-43cc-9c12-7a594bc8359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:46.063536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c886c675-90fd-43cc-9c12-7a594bc8359d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:46.064739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c886c675-90fd-43cc-9c12-7a594bc8359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:46.073684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:46.166405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:46.445225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:46.447511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:46.558960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d326-efb6-4a88-99fa-daaa652a1ae8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:46.621736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:46.640766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:46.641285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:46.641555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:46.641850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:46.643453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:46.759423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:46.760856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a2cc-ccd6-4cec-bbd5-0241b317576c service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:46.782817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 569/1138] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:48.991325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:48.992246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:48.992246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:48.994710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:49.001037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5abcb-e058-4ca1-974b-1af5f625ecbf None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:49.001717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5abcb-e058-4ca1-974b-1af5f625ecbf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:49.001919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5abcb-e058-4ca1-974b-1af5f625ecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:49.074821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bbe5abcb-e058-4ca1-974b-1af5f625ecbf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:49.076037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bbe5abcb-e058-4ca1-974b-1af5f625ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:49.117604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:49.178587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:49.463716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:49.465273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:49.575872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bae4e-2207-4e61-935b-532175b3c3ed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:49.624443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:49.661898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:49.662533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:49.662806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:49.663072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:49.664763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:49.777996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:49.779346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79a49e-e0bb-4ead-9674-f5b4a491c512 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:49.798210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 571/1141] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:51.933969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:51.934532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:51.934532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:51.935903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:51.941458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b85c8-702e-441f-af43-ab98ba4ba5a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:51.941948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b85c8-702e-441f-af43-ab98ba4ba5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:51.942052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b85c8-702e-441f-af43-ab98ba4ba5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:52.010213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b41b85c8-702e-441f-af43-ab98ba4ba5a7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:52.011402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b41b85c8-702e-441f-af43-ab98ba4ba5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:52.029619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:52.110705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:52.394198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:52.396760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:52.511311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f466d-28ba-4be4-99a3-88941a007b62 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:52.581085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:52.589525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:52.590158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:52.590443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:52.590703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:52.592318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:52.712388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:52.713759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb102a7-b3ae-417f-aac4-457d21f05f86 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:52.733601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 572/1144] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:37:54.991736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:54.992279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:54.992279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:54.994132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:37:54.999824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d8304-4293-4cb5-a6f7-f2b41c552d3b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:55.000268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d8304-4293-4cb5-a6f7-f2b41c552d3b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:55.000372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d8304-4293-4cb5-a6f7-f2b41c552d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:55.067622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c08d8304-4293-4cb5-a6f7-f2b41c552d3b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:37:55.068830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c08d8304-4293-4cb5-a6f7-f2b41c552d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:55.119233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:55.175611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:37:55.462705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:37:55.464278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:55.579099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879120c0-1716-406a-90d6-39568eeeac13 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:37:55.629782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:37:55.661604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:37:55.662229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:37:55.662501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:37:55.662766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:37:55.664363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:37:55.780791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:37:55.782200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973b83-7533-44c7-913b-907bce2d679d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:37:55.800957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 574/1147] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:05.173989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=22 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:05.798721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=66 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:15.850241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025311-8957-48da-80f4-64e3b60fdbfb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:15.851108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025311-8957-48da-80f4-64e3b60fdbfb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:15.851108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025311-8957-48da-80f4-64e3b60fdbfb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:15.853658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 574/1148] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:15.863157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38740-3aa7-403c-8a31-341bd99a86f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:15.863596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38740-3aa7-403c-8a31-341bd99a86f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:15.863742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38740-3aa7-403c-8a31-341bd99a86f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:15.936091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5ec38740-3aa7-403c-8a31-341bd99a86f4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:15.937288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5ec38740-3aa7-403c-8a31-341bd99a86f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:16.035829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 575/1149] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:16.336050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:16.336330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:16.336601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:16.338300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 575/1150] 10.222.0.62 () {54 vars in 962 bytes} [Mon Oct 17 17:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:16.344579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3c37a-7fd3-49f1-96f2-6f9ad8328638 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:16.344904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3c37a-7fd3-49f1-96f2-6f9ad8328638 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:16.345231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3c37a-7fd3-49f1-96f2-6f9ad8328638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:16.431769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-35c3c37a-7fd3-49f1-96f2-6f9ad8328638 None None] MFA Rules not processed for user `ea10fd96c9fa48809e2dfa85b11d8d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:16.433002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-35c3c37a-7fd3-49f1-96f2-6f9ad8328638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:16.454954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:16.511489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 576/1151] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Oct 17 17:38:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:38:16.520212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:16.521788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:16.637874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d8806-86b7-43ae-a64b-bf765bf57c7f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:16.717558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:16.718115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:16.718391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:16.718651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:16.720246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:16.779598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:16.838492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:16.840080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed141d-f4fc-4f19-932a-a8209d312b25 service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:16.859554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 576/1152] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:19.136920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:19.137980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:19.137980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:19.140053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 577/1153] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:19.146557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813047a-d0b7-49ea-ba47-9ec73b7986ce None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:19.147271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813047a-d0b7-49ea-ba47-9ec73b7986ce None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:19.147438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813047a-d0b7-49ea-ba47-9ec73b7986ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:19.228222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d813047a-d0b7-49ea-ba47-9ec73b7986ce None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:19.229446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d813047a-d0b7-49ea-ba47-9ec73b7986ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:19.332691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 577/1154] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:19.609348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:19.610946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:19.751325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd2b3-e865-4f61-abfa-74517434457d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:19.803980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:19.852298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:19.853069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:19.853358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:19.853627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:19.854273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:19.855300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:38:19.855300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:38:19.855300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:38:19.856432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167c9d1-2dc0-445c-9ba8-ff5ded2d7fdc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:19.876468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 578/1155] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Oct 17 17:38:19 2022] GET /identity/v3/projects => generated 2553 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:38:22.068039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:22.068945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:22.068945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:22.071170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 578/1156] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:22.077834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068854-ef18-4dd2-8bb9-76779cdf4dec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:22.078278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068854-ef18-4dd2-8bb9-76779cdf4dec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:22.078429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068854-ef18-4dd2-8bb9-76779cdf4dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:22.156251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-16068854-ef18-4dd2-8bb9-76779cdf4dec None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:22.157445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-16068854-ef18-4dd2-8bb9-76779cdf4dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:22.260668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 579/1157] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:22.560538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:22.562034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:22.572362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:22.721706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403b735-da9e-490b-bd15-ff79272d5999 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:22.814584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:22.852774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:22.853468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:22.853781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:22.854049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:22.855669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:22.951406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:22.953018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c285e-66e3-4226-87c7-88681e6d25b2 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:22.971483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 579/1158] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:25.337848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:25.338489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:25.338489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:25.339728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 580/1159] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:25.348476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6239-2c39-4469-87c6-7153af144ea5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:25.349199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6239-2c39-4469-87c6-7153af144ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:25.349328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6239-2c39-4469-87c6-7153af144ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:25.428264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-57af6239-2c39-4469-87c6-7153af144ea5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:25.429511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-57af6239-2c39-4469-87c6-7153af144ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:25.477856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:25.533878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 580/1160] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:38:25.841209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:25.842819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:25.868284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:25.957323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd9caf-ad81-477b-9007-732adb8a869e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:26.033516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:26.034148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:26.034417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:26.034681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:26.036271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:26.114229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:26.150668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:26.152115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ff875-015f-4b1e-a687-5764e8ba1f3b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:26.172262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 581/1161] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:28.391507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724289fb-8762-40fa-b386-4f955c60651c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:28.392392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724289fb-8762-40fa-b386-4f955c60651c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:28.392392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724289fb-8762-40fa-b386-4f955c60651c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:28.394644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 581/1162] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:28.400251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977e4f-f527-4f54-87ec-a7664619101f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:28.400705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977e4f-f527-4f54-87ec-a7664619101f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:28.400804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977e4f-f527-4f54-87ec-a7664619101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:28.476253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6e977e4f-f527-4f54-87ec-a7664619101f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:28.477449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e977e4f-f527-4f54-87ec-a7664619101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:28.582526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 582/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:28.872344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724289fb-8762-40fa-b386-4f955c60651c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:28.874814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-724289fb-8762-40fa-b386-4f955c60651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:28.989423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724289fb-8762-40fa-b386-4f955c60651c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:29.073275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:29.075003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:29.075582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:29.075898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:29.076109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:29.078431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:29.210277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:29.211633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a12ea1-2615-4fe8-9b24-cebf57365936 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:29.231004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 582/1164] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:31.633053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:31.634013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:31.634013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:31.636253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 583/1165] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:31.644860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e20c3-0e4f-4fbc-99b3-257e11a17e64 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:31.645306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e20c3-0e4f-4fbc-99b3-257e11a17e64 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:31.645412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e20c3-0e4f-4fbc-99b3-257e11a17e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:31.720836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4c6e20c3-0e4f-4fbc-99b3-257e11a17e64 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:31.722001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c6e20c3-0e4f-4fbc-99b3-257e11a17e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:31.778376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:31.826927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 583/1166] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:32.128256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:32.129845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:32.175641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:32.262553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881f219-8aa0-474d-a4e8-836fcf28c015 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:32.344779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:32.345309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:32.345629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:32.345892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:32.347503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:32.439063 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:32.470359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:32.471812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b764ba-f68d-40c3-8717-06fbf69cc3cf service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:32.490052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 584/1167] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:34.824733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:34.825570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:34.825570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:34.827761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 584/1168] 10.222.0.62 () {54 vars in 927 bytes} [Mon Oct 17 17:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:38:34.834242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6928-c49d-4aa5-b0ad-861c954f8bf0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:34.834678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6928-c49d-4aa5-b0ad-861c954f8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:34.834804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6928-c49d-4aa5-b0ad-861c954f8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:34.916034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c0ef6928-c49d-4aa5-b0ad-861c954f8bf0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:38:34.917236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c0ef6928-c49d-4aa5-b0ad-861c954f8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:35.024456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 585/1169] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Oct 17 17:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:38:35.317904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:38:35.320369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:35.435900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6109-a814-47c9-949d-2b253d531d21 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:38:35.518631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:38:35.519248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:38:35.519522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:38:35.519786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:38:35.521383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:38:35.530379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:35.636921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:38:35.638453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33259-bf2c-4460-86b7-5efe881431d4 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:38:35.657519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 585/1170] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:38:45.022357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:38:45.655196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=50 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:55.897751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:55.898340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:55.898340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:55.986474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:39:55.987667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:56.093515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 586/1171] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:39:56.106052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:56.106816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:56.106816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:56.192441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:39:56.193607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:56.298545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 586/1172] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:39:56.304377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:56.306355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:56.319554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cbf0a-ced2-43d1-a479-a3bd6001a5c3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:56.390147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:56.425854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:56.426468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:56.426746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:56.427014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:56.427656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:39:56.427955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:56.428969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:39:56.428969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:39:56.428969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:39:56.429894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:56.447598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 587/1173] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:39:56.455615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:56.464959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab9abc-d0f1-40dc-9ce2-2e6932b1d96d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:56.528168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:56.562374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:56.562993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:56.563270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:56.563535 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:56.564162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:56.565268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:39:56.565268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:39:56.565268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:39:56.566598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:56.624453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 587/1174] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:39:56 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:39:56.628977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:56.630590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:56.664942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d114-cb96-44c0-8cfb-1bf6fd4072f6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:56.772967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:56.773534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:56.773842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:56.774116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:56.774759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:56.775791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:39:56.775791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:39:56.775791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:39:56.777338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:56.823060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 588/1175] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:39:56 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:39:56.828002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:56.829631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:56.896046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e39e-ff36-411a-b1fb-79e3f0d8fc25 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:56.987177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:56.999496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:57.000115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.000399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.000668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.001304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:57.002963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:57.016087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 588/1176] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:39:57.020374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:57.021929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:57.034036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02a952-bd9e-4715-832c-bd70fea5c65e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:57.060866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:57.144219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:57.144833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.145112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.145372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.146046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:57.147658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaa35f-bb96-4b6d-a511-2297ccd8e8fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:57.161213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 589/1177] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:39:57.167249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:57.169036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:57.203499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f16eb-1acc-4084-91a8-fa37d66c1109 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:57.307790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:57.308373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.308673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.308978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] PATH_INFO: `/v3/projects/74158c12bcee41ee84a0c8627ac56fb9/users/6995142bc32947abbb0822afd28f5686/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.334375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74158c12bcee41ee84a0c8627ac56fb9, user_id=6995142bc32947abbb0822afd28f5686, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:57.337045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc22381-54b4-44a1-acd3-710a811fd038 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:57.364372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 589/1178] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:39:57 2022] PUT /identity/v3/projects/74158c12bcee41ee84a0c8627ac56fb9/users/6995142bc32947abbb0822afd28f5686/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:39:57.376154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251212a4-dc23-4229-8bb4-b84011ed95d7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.376445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251212a4-dc23-4229-8bb4-b84011ed95d7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.376719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251212a4-dc23-4229-8bb4-b84011ed95d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.436610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-251212a4-dc23-4229-8bb4-b84011ed95d7 None None] MFA Rules not processed for user `6995142bc32947abbb0822afd28f5686`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:39:57.437834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-251212a4-dc23-4229-8bb4-b84011ed95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:57.519717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 590/1179] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:39:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:39:57.534636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.535026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.535402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.537501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 590/1180] 10.222.0.62 () {54 vars in 963 bytes} [Mon Oct 17 17:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:39:57.544509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa89f-ec88-4b59-8d65-1a064e7af813 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.544798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa89f-ec88-4b59-8d65-1a064e7af813 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.545058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa89f-ec88-4b59-8d65-1a064e7af813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.579364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:57.626901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1bafa89f-ec88-4b59-8d65-1a064e7af813 None None] MFA Rules not processed for user `cb97ad1bfae943289b1b967065937396`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:39:57.628115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1bafa89f-ec88-4b59-8d65-1a064e7af813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:57.711276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 591/1181] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Oct 17 17:39:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:39:57.719691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:57.721214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:57.772844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:57.828880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337426-284b-42cf-9b8a-9318c24c4a85 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:57.915327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:57.915925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:57.916201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:57.916472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:57.918378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:58.024593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:58.026061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:58.029688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:58.045885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 591/1182] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:39:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:39:58.092231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729a73-ff42-42b0-90cc-69f9c3e40902 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:58.092724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729a73-ff42-42b0-90cc-69f9c3e40902 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:58.092829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729a73-ff42-42b0-90cc-69f9c3e40902 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:58.094082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 592/1183] 10.222.0.62 () {52 vars in 830 bytes} [Mon Oct 17 17:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:39:58.097822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:58.099186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:58.208123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f400-ced0-43c4-af7d-ef2276b67a16 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:58.307898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:58.308581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:58.308873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:58.309137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] PATH_INFO: `/v3/users/6995142bc32947abbb0822afd28f5686` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:58.322573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6995142bc32947abbb0822afd28f5686)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:58.323741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:39:58.323741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:39:58.323741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:39:58.324952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:58.335501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:58.395881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6995142bc32947abbb0822afd28f5686'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:58.407419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6995142bc32947abbb0822afd28f5686'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:58.433547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6995142bc32947abbb0822afd28f5686'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:58.434119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6995142bc32947abbb0822afd28f5686'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:58.448595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6995142bc32947abbb0822afd28f5686'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:58.454710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 592/1184] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:39:58 2022] DELETE /identity/v3/users/6995142bc32947abbb0822afd28f5686 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:39:58.459462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:58.459654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:58.459944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:58.521376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:39:58.522619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:58.600709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:58.613715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 593/1185] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:39:58.624011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:58.625271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:58.730252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671a48f-72fc-49e3-ad42-00323cd86c6c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:58.790670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:39:58.813191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:58.813831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:58.814100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:58.814369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:58.815996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:58.928046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:58.929565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300227b-1405-47ff-9f53-0dd5eb2ce415 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:58.954900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 593/1186] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:39:59.304269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:39:59.305747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:39:59.319970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7cef5-9d4b-4100-88e4-9a6293a9d7da None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:39:59.432126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:39:59.432769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:39:59.433052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:39:59.433319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] PATH_INFO: `/v3/projects/74158c12bcee41ee84a0c8627ac56fb9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:39:59.446394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74158c12bcee41ee84a0c8627ac56fb9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:39:59.447435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:39:59.447435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:39:59.447435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:39:59.448695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:39:59.511696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74158c12bcee41ee84a0c8627ac56fb9', 'request_id': 'req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:59.522456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74158c12bcee41ee84a0c8627ac56fb9', 'request_id': 'req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:59.528736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74158c12bcee41ee84a0c8627ac56fb9', 'request_id': 'req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:59.561558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] The token cache is being invalidate because project 74158c12bcee41ee84a0c8627ac56fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:39:59.561780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:59.562197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-83896fc9-bdb2-45b1-9738-9b4bd98e33e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:39:59.563602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 594/1187] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:39:59 2022] DELETE /identity/v3/projects/74158c12bcee41ee84a0c8627ac56fb9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:40:08.952176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=62 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:40:09.559014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:41:40.595853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:40.596468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:40.596468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:40.597806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 594/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:41:40.602792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693607-e918-4328-a664-41a9fb5752dd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:40.603250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693607-e918-4328-a664-41a9fb5752dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:40.603352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693607-e918-4328-a664-41a9fb5752dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:40.689257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-83693607-e918-4328-a664-41a9fb5752dd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:40.690490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-83693607-e918-4328-a664-41a9fb5752dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:40.804752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 595/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:41:40.962506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:41:40.964957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:41.077032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed253db-2c57-48c7-b607-39321efaf158 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:41.077247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed253db-2c57-48c7-b607-39321efaf158 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:41.077508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed253db-2c57-48c7-b607-39321efaf158 None None] PATH_INFO: `/v3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:41.078809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 596/1190] 10.222.0.26 () {54 vars in 925 bytes} [Mon Oct 17 17:41:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:41:41.084902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea6e8-d806-40df-b274-658b53adb158 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:41.085289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea6e8-d806-40df-b274-658b53adb158 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:41.085652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea6e8-d806-40df-b274-658b53adb158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:41.114231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d92e6-434e-4485-8b3f-90fb35ac3ab4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:41:41.121847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:41:41.122485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:41.122758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:41.123036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:41.133120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:41:41.135544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a965b-0399-47d7-9f5f-3e84d31a6c87 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:41:41.148699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 595/1191] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:41:41.148889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fc1ea6e8-d806-40df-b274-658b53adb158 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:41.150052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc1ea6e8-d806-40df-b274-658b53adb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:41.184704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:41:41.247264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 597/1192] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 17 17:41:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:41:42.267353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35920cd7-f660-4f61-962d-64eca0ea1b24 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:42.268068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35920cd7-f660-4f61-962d-64eca0ea1b24 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:42.268068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35920cd7-f660-4f61-962d-64eca0ea1b24 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:42.269753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 596/1193] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:41:42.276415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5bdc-33ab-47a2-abf2-85945b9eac10 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:42.276863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5bdc-33ab-47a2-abf2-85945b9eac10 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:42.276976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f5bdc-33ab-47a2-abf2-85945b9eac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:42.298413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a73f5bdc-33ab-47a2-abf2-85945b9eac10 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:42.299619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a73f5bdc-33ab-47a2-abf2-85945b9eac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:42.308700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 598/1194] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:41:42.468629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35920cd7-f660-4f61-962d-64eca0ea1b24 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:41:42.488294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35920cd7-f660-4f61-962d-64eca0ea1b24 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:41:42.495308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:41:42.496060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:42.496380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:42.496783 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:42.507485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:41:42.509492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df671fef-c99a-4958-8e1c-e49df557dc06 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:41:42.523635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 597/1195] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:41:49.965090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974706-bcac-4d92-a89f-cd41e9ec5c1d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:49.965643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974706-bcac-4d92-a89f-cd41e9ec5c1d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:49.965643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974706-bcac-4d92-a89f-cd41e9ec5c1d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:49.967061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 599/1196] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:41:49.972488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208fb5-751d-479a-abbd-3fd63ce7e454 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:49.972966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208fb5-751d-479a-abbd-3fd63ce7e454 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:49.973075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208fb5-751d-479a-abbd-3fd63ce7e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:49.993461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-49208fb5-751d-479a-abbd-3fd63ce7e454 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:49.994712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49208fb5-751d-479a-abbd-3fd63ce7e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:50.004786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 598/1197] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:41:50.012666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35974706-bcac-4d92-a89f-cd41e9ec5c1d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:41:50.027282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35974706-bcac-4d92-a89f-cd41e9ec5c1d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:41:50.032837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:41:50.033436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:50.033743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:50.034019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:50.042575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:41:50.044337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f69738-e727-465e-bb20-e73f35c4a487 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:41:50.054210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 600/1198] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:41:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:41:54.202147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ece6e-9972-4cab-9a67-b76e68e392a8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:54.202768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ece6e-9972-4cab-9a67-b76e68e392a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:54.202768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ece6e-9972-4cab-9a67-b76e68e392a8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:54.204617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 599/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:41:54.212591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7d4c-ab3e-4769-b7b0-47f0da250f6b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:54.213203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7d4c-ab3e-4769-b7b0-47f0da250f6b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:54.213795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7d4c-ab3e-4769-b7b0-47f0da250f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:54.236387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-327a7d4c-ab3e-4769-b7b0-47f0da250f6b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:54.237692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-327a7d4c-ab3e-4769-b7b0-47f0da250f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:54.247776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 601/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:41:54.409971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ece6e-9972-4cab-9a67-b76e68e392a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:41:54.426516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ece6e-9972-4cab-9a67-b76e68e392a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:41:54.432530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:41:54.433137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:54.433415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:54.433713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:54.444035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:41:54.445694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2c01-c7de-43c1-a32e-c1904e306cea service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:41:54.455899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 600/1201] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:41:55.542823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34421-ac27-4a60-9366-988482d3cb17 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:55.543483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34421-ac27-4a60-9366-988482d3cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:55.543483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34421-ac27-4a60-9366-988482d3cb17 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:55.545144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 602/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 17:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:41:55.552752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e58ac-6e2c-4976-891f-1099e3137477 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:55.553236 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e58ac-6e2c-4976-891f-1099e3137477 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:55.553350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e58ac-6e2c-4976-891f-1099e3137477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:55.576370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-012e58ac-6e2c-4976-891f-1099e3137477 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:41:55.577569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-012e58ac-6e2c-4976-891f-1099e3137477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:41:55.586940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 601/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 17:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:41:55.741630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e34421-ac27-4a60-9366-988482d3cb17 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:41:55.757320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e34421-ac27-4a60-9366-988482d3cb17 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:41:55.764506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:41:55.765114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:41:55.765390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:41:55.765812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:41:55.774942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:41:55.776569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ba7c8-a483-4fba-9a63-fb6a8e03fe1f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:41:55.787343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 603/1204] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:42:00.512594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:00.513147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:00.513147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:00.514456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 602/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:42:00.521243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170240-b4e9-4720-9960-ab24dcd0fd64 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:00.521695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170240-b4e9-4720-9960-ab24dcd0fd64 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:00.521853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170240-b4e9-4720-9960-ab24dcd0fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:00.550485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e1170240-b4e9-4720-9960-ab24dcd0fd64 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:42:00.551697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1170240-b4e9-4720-9960-ab24dcd0fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:00.560153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 604/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:42:00.856221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:42:00.858207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:00.955041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:42:00.966792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4178-e2af-436d-938c-a0ebd8da9de3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:42:00.971112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:42:00.971840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:00.972120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:00.972387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:00.985495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:42:00.987082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95873ed-0826-41f5-81fc-3853e0e310d9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:42:00.997790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 603/1207] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:42:03.281159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0fa3-d209-4985-bd04-cd5591e806ef None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:03.281779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0fa3-d209-4985-bd04-cd5591e806ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:03.281779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0fa3-d209-4985-bd04-cd5591e806ef None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:03.283169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 605/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:42:03.288648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca96a5f-38e9-4912-b8f6-1e71c1375a5f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:03.289094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca96a5f-38e9-4912-b8f6-1e71c1375a5f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:03.289220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca96a5f-38e9-4912-b8f6-1e71c1375a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:03.313902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1ca96a5f-38e9-4912-b8f6-1e71c1375a5f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:42:03.315518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1ca96a5f-38e9-4912-b8f6-1e71c1375a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:03.325033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 604/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:42:03.684098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0fa3-d209-4985-bd04-cd5591e806ef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:42:03.698264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0fa3-d209-4985-bd04-cd5591e806ef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:42:03.704082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:42:03.704922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:03.705399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:03.705715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:03.717643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:42:03.719692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8801c-5517-4124-b711-e719a51d6e7f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:42:03.732064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 606/1210] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:42:07.683047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:07.683620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:07.683620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:07.685233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 605/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:42:07.691352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b7e8-9ece-45de-b53e-6ea1fc664f90 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:07.691352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b7e8-9ece-45de-b53e-6ea1fc664f90 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:07.691889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b7e8-9ece-45de-b53e-6ea1fc664f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:07.711801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74e9b7e8-9ece-45de-b53e-6ea1fc664f90 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:42:07.712902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74e9b7e8-9ece-45de-b53e-6ea1fc664f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:07.721134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 607/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:42:08.020500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:42:08.022250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:08.105860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a397b7-1b46-4c7a-85e2-1ad383d8afa4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:42:08.110816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:42:08.111463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:08.111744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:08.112014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:08.123150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:42:08.124606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2b4f4-903b-433c-82b0-ae7849d715e0 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:42:08.138778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 606/1213] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:42:10.321438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:10.322048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:10.322048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:10.324107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 608/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 17:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:42:10.331692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5b74-6da2-422f-b2a0-25dd4f7cb18e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:10.332135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5b74-6da2-422f-b2a0-25dd4f7cb18e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:10.332252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5b74-6da2-422f-b2a0-25dd4f7cb18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:10.353058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-156d5b74-6da2-422f-b2a0-25dd4f7cb18e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:42:10.354336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-156d5b74-6da2-422f-b2a0-25dd4f7cb18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:10.363279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 607/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 17:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:42:10.661038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:42:10.663111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:42:10.677466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6f47d-e6c0-408f-9739-f8c3f4db76ed None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:42:10.682941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:42:10.683544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:42:10.683821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:42:10.684091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:42:10.694305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:42:10.695774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b78eb5-a2d9-4fe0-80de-0293aa82ee38 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:42:10.705545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 609/1216] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:42:20.347450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=47 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:42:20.701464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=53 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:37.407167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.408431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.408431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.429124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:37.430733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:37.443241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 608/1217] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:37.457564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.458065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.458157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.487064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:37.488331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:37.501494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 610/1218] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:37.506938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.520332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c101-9422-4804-90f9-74bfc39965ee None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.528962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.529930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.530451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.530942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.531810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:37.532327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.533550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:43:37.533550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:43:37.533550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:43:37.534838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.551519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 609/1219] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:37.561088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.577458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d20be-c664-4a68-b358-05ddb26940f3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.586243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.587003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.587340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.587611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.588253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.589342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:43:37.589342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:43:37.589342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:43:37.590844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.644009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 611/1220] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:37 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:37.649112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.666662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062ecc8-14f4-40da-80ad-9f0626d440ec admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.756531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.757702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.758223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.758716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.759874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.761173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:43:37.761173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:43:37.761173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:43:37.762832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.795991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 610/1221] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:37 2022] POST /identity/v3/users => generated 283 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:37.800949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.819778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7489c1-da61-486f-b58a-4a94eec0744a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.828223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.828864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.829144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.829421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.830099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.831721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.847683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 612/1222] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:37.853212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.868331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4557c-d93a-4c9c-945a-6ec744adbca0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.878502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.879560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.880058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.880583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.882237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.884136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f7991-6376-435c-ade6-d1fa2636bc3b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.897749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 611/1223] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:37.902598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:37.921007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173093a1-1472-4a58-80fb-9dc354208a4c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:37.931033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:37.931921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.932202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.932476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] PATH_INFO: `/v3/projects/6de02a13c7004941b3bbec1330a38490/users/89724d7e1c394159956fd71a6e194e44/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:37.958048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de02a13c7004941b3bbec1330a38490, user_id=89724d7e1c394159956fd71a6e194e44, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:37.961231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60a5ac-699c-41bd-addf-566708fbbe03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:37.984049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 613/1224] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:37 2022] PUT /identity/v3/projects/6de02a13c7004941b3bbec1330a38490/users/89724d7e1c394159956fd71a6e194e44/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:37.997093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:37.997796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:37.998360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.039786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c72a-2370-4f1b-a78d-bff824aeccb7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.040335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c72a-2370-4f1b-a78d-bff824aeccb7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.040614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c72a-2370-4f1b-a78d-bff824aeccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.051591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] MFA Rules not processed for user `89724d7e1c394159956fd71a6e194e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.053622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.073325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e8c9c72a-2370-4f1b-a78d-bff824aeccb7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.074897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8c9c72a-2370-4f1b-a78d-bff824aeccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.172847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 612/1225] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:38.177502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.177756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 614/1226] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.187144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.187458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.187741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.195502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d277b0-6940-4996-9b3c-f2f194f50b57 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.203193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.203819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.204096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.204366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.205006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.206954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1feb44-21e9-419b-8f85-61ca8f224459 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.219897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.221136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.236759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 615/1227] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:38.248258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.261555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 613/1228] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:43:38.264540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5f1d-e297-4b2e-90b8-a0749df9cccb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.264881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5f1d-e297-4b2e-90b8-a0749df9cccb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.265187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5f1d-e297-4b2e-90b8-a0749df9cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.266485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22160d-8cbc-4c4c-bf76-bcf433e09f72 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.315505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-50cf5f1d-e297-4b2e-90b8-a0749df9cccb None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.316813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-50cf5f1d-e297-4b2e-90b8-a0749df9cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.368253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:38.384450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.385720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.386117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.386404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.387084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.387397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.389032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.400958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 616/1229] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.401790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.420864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 614/1230] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.420864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c79-65f8-4ea0-9b5f-5e37396af9c7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.420864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c79-65f8-4ea0-9b5f-5e37396af9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.420864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c79-65f8-4ea0-9b5f-5e37396af9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.422018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87acaa-a592-4f1e-8949-5df1003f8f2b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.425923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.426481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.426757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.427032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.427709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.429730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0ae15-c035-497b-8382-d1292513c10b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.439400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0d434c79-65f8-4ea0-9b5f-5e37396af9c7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.440514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0d434c79-65f8-4ea0-9b5f-5e37396af9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.447259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:38.451633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 615/1231] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.452182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b39-f955-46b1-8f54-f65a54511c76 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.452294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b39-f955-46b1-8f54-f65a54511c76 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.452508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b39-f955-46b1-8f54-f65a54511c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.461915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 617/1232] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:38.463167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03184-9b00-4dd8-866a-bf42db08c709 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.463449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03184-9b00-4dd8-866a-bf42db08c709 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.463719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03184-9b00-4dd8-866a-bf42db08c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.476375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7c616b39-f955-46b1-8f54-f65a54511c76 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.477615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7c616b39-f955-46b1-8f54-f65a54511c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.483359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d0b03184-9b00-4dd8-866a-bf42db08c709 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.484529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d0b03184-9b00-4dd8-866a-bf42db08c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.485732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 616/1233] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.486737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.487012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.487278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.499719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 618/1234] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.500959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdcd-a72d-43ef-9a5f-97446964dadf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.501369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdcd-a72d-43ef-9a5f-97446964dadf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.501679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdcd-a72d-43ef-9a5f-97446964dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.512809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.514072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.520814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e826cdcd-a72d-43ef-9a5f-97446964dadf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.522041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e826cdcd-a72d-43ef-9a5f-97446964dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.523043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 617/1235] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.523816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.533708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba3e04-db67-4688-98f1-a453ae8d0230 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.535841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 619/1236] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.537135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea974d-ef85-4de4-a9e6-ff7225139283 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.537418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea974d-ef85-4de4-a9e6-ff7225139283 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.537726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea974d-ef85-4de4-a9e6-ff7225139283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.539955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.540572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.540851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.541123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.541805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.544782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.557901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-acea974d-ef85-4de4-a9e6-ff7225139283 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.559113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-acea974d-ef85-4de4-a9e6-ff7225139283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.567487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 620/1237] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.571735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667fd7-30f4-40ab-a3d2-b08aebd70b33 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.571735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667fd7-30f4-40ab-a3d2-b08aebd70b33 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.571735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667fd7-30f4-40ab-a3d2-b08aebd70b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.582196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 618/1238] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:38.582196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.588784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4f667fd7-30f4-40ab-a3d2-b08aebd70b33 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.589994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f667fd7-30f4-40ab-a3d2-b08aebd70b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.646172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0543f-b622-4713-9938-a4e8d0d6ca38 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.653655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 621/1239] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.653843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.653973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768cdba-d28e-4340-90b9-bc956fdc8a68 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.654066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.654173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768cdba-d28e-4340-90b9-bc956fdc8a68 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.654278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.654392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768cdba-d28e-4340-90b9-bc956fdc8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.654482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.654482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.654656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2b0f-adb8-44fe-b09e-c4ae8ec9c265 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.665232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 619/1240] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:38.666507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a839-801d-4f25-ad51-8076efd2881e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.666793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a839-801d-4f25-ad51-8076efd2881e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.667068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a839-801d-4f25-ad51-8076efd2881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.675279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7768cdba-d28e-4340-90b9-bc956fdc8a68 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.676537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7768cdba-d28e-4340-90b9-bc956fdc8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.685144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 622/1241] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.686389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952777-4a44-42f3-a612-f219920b600a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.686516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4cd4a839-801d-4f25-ad51-8076efd2881e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.686699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952777-4a44-42f3-a612-f219920b600a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.686940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952777-4a44-42f3-a612-f219920b600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.687634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4cd4a839-801d-4f25-ad51-8076efd2881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.697024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 620/1242] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.700786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.700786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.700786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.707043 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-82952777-4a44-42f3-a612-f219920b600a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.708234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82952777-4a44-42f3-a612-f219920b600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.716565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 623/1243] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.717350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82952777-4a44-42f3-a612-f219920b600a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.718220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:38.719392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:38.726755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82952777-4a44-42f3-a612-f219920b600a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.727894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 621/1244] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:38.728638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.735269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.735891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.736166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.736426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.737067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.737369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.738420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13d29d-ce33-43fa-b8df-ca98daa50b56 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.739007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.743316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.743948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.744555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.744847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.745472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.747395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.751311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 624/1245] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.751926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.762407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d45d2-d3d4-4bfa-8f06-b47968584a76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.767583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.768186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.768495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.768773 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.769423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.769759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.770714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 622/1246] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:38.771460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.771688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.783242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36166-445c-44af-8a29-c96fc733a61b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.784498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 625/1247] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.785465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.795598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.795827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa599-400d-480b-a38c-6429724d8c33 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.796264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.796580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.796828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] PATH_INFO: `/v3/projects/2c4b324171dc4defbffb3a14f3e26170/users/029f1c0d8911480fabf4adcdfb4ee522/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.800461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.801050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.801330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.801634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.802282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.802639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.804606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.812206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4b324171dc4defbffb3a14f3e26170, user_id=029f1c0d8911480fabf4adcdfb4ee522, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.814904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.816456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 626/1248] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.817429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.828850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546b7f-f9eb-47e5-bab0-2a6fb5167dd2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.834406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 623/1249] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:38 2022] PUT /identity/v3/projects/2c4b324171dc4defbffb3a14f3e26170/users/029f1c0d8911480fabf4adcdfb4ee522/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:38.835427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.865120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:38.894225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.894838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.895115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.895385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.896022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.896427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.898228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.900249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c8e0-400b-4bdb-be11-d204ea7b6037 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.904859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.905452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.905797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.906151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.906849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.907151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.908722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.909833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 627/1250] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.910745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.920898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 624/1251] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.921571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.927244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11cc4d-73fb-4e1e-8250-ed1c3f2546dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.931888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563477-8c91-4ee1-918d-d2da29513298 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.932169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.932890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.933105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.933376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.934055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:38.934357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.935976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.936613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.937288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.937685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.937961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.938583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.940448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.948756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 628/1252] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:38.949881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.966057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e04e0-c4aa-41a0-b83e-bb571763abac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:38.969902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 625/1253] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:38.970739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.970875 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:38.971463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:38.971741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:38.972009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:38.972667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:38.974647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:38.976408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:38.989421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 629/1254] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:38.989421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:38.997986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9122-dbcc-4b0a-9fc8-eb3c10a91a8e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.038815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c238b-44dd-446c-bdfb-60370dfd238e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.043955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.044569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.044845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.045117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.045784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.047747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.056006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.056611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.056886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.057162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.057808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.059685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.078676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 626/1255] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.078676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.093198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 630/1256] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:38 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.094201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.141424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7a30-d083-4863-9bc3-7307572eb6a7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.155608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d889d4-1ed6-4a26-8fdf-e406ad157057 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.160211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.160813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.161089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.161355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.162064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.164019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.171318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:39.193672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 631/1257] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.194596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.201192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.201839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.202117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.202394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.203043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.204633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.214736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 627/1258] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.218482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.228765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303756-b54d-4f31-8132-ae38161191e2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.262077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78779-5485-4e50-97cc-b135a5f7ce6d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.266967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.267569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.267879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.268185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.268850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.270845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.282371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:39.295261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.295881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.296160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.296450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.297117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.298896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 632/1259] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.299064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.299756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.330038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 628/1260] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.330038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.366479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586701-7ef1-42fe-b219-7db32449ebe8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.389237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d40f-1432-4b76-976e-7d828dbaf90c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.394732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.395351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.395726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.396444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.396814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.398475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.409073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 629/1261] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.409996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.419900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383835b-cb77-4217-98ad-ebc1c2ee8e6c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.424784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.425488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.425885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.426250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.426969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.427286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.428142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.428692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.428949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.429494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.429685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.431548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.454330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 633/1262] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.455573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.455669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 630/1263] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.456516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.467285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436acb4-c6fe-4146-afd0-d600e97c1533 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.467826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66cf1-c43d-4801-8c85-4e0bb924a235 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.472018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.472252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.472612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.472851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.472979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.473152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.473261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.473503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.473818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.474168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.476171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.476294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.498271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 634/1264] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.499325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.503707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 631/1265] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.503707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.509450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2e0c9-1a90-463e-8097-ba3db6ac099b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.513511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2c8c-9321-4d64-b8e6-d8f469b639be admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.514754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.515409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.515686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.515959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] PATH_INFO: `/v3/projects/2c4b324171dc4defbffb3a14f3e26170/users/029f1c0d8911480fabf4adcdfb4ee522/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.518034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4b324171dc4defbffb3a14f3e26170, user_id=029f1c0d8911480fabf4adcdfb4ee522, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.518387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.518974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.519254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.519523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.520149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.520686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.522572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.532854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 635/1266] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:39 2022] PUT /identity/v3/projects/2c4b324171dc4defbffb3a14f3e26170/users/029f1c0d8911480fabf4adcdfb4ee522/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:39.533707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:39.535753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.547742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 632/1267] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.548829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.558806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223cc6-27f4-4d2d-85b5-d5134298fb89 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.597405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:39.601383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49b84-387e-448d-b764-28a918fcace8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.607181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.607789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.608065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.608333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.608969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.610968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.617407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.618104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.618384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.618646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] PATH_INFO: `/v3/projects/9dd41804230f4f3fb9645902c8cd514e/users/f85377460b0a4e6381d7597f0c59082b/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.632880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 636/1268] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:39.633741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.635284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd41804230f4f3fb9645902c8cd514e, user_id=f85377460b0a4e6381d7597f0c59082b, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.638263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.643815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fcaed-7bb3-4636-a216-d94b18843cb3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.649544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.650155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.650591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.650899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.651527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.652928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 633/1269] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:39 2022] PUT /identity/v3/projects/9dd41804230f4f3fb9645902c8cd514e/users/f85377460b0a4e6381d7597f0c59082b/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:39.653146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.653829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.664061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 637/1270] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.664992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.674518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29512243-2840-4cc6-a0ec-60ac73908a78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.719449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d03b-58ec-4029-a869-d0058a60ed0c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.724025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.724856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.725232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.725519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.726196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.727798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.731161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.731768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.732041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.732310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.732945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.734562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cba1f-d527-4fae-9dc1-bfc5c935d6f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.738032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 634/1271] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.738840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.749602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 638/1272] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.749602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.749602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.749602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.750040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be9f-01df-4bdd-93ca-73f22c59b532 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.754031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.754625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.754901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.755174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.755840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.757441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.768280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 635/1273] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.769143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.779408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3c8f0-a131-413c-a84f-5b0ddfcaa6ba admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.780251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] MFA Rules not processed for user `029f1c0d8911480fabf4adcdfb4ee522`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:39.781551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:39.784821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.785413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.785724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.785986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.786641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.788284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.799743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 636/1274] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.801043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.811772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c72-6b6f-4489-9116-1b7c610a9e4c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.816417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.816997 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.817277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.817549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.818242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.820136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba6b14-b975-478b-b373-b97c08dc8baf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.829933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 637/1275] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.831086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.831370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.831646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.853450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 639/1276] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:39.854522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.859822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] MFA Rules not processed for user `f85377460b0a4e6381d7597f0c59082b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:39.861046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:39.865259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9262e-a4d2-4c5f-899d-e5d17452f774 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.871725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.872340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.872618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.872887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.873530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.875191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.885639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 640/1277] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.886445 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.893362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:39.896615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813ff3-75c4-4817-8d13-112f1d0821d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.902553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.903150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.903807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.903807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.904337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.905973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.919643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 641/1278] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.919643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.926953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172bda4-e25a-49e7-8b7e-bc286c5e5741 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.930180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 638/1279] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:39.931019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.932597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.933483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.933888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.934173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.934812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.936406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.941770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ed67-7f37-4ca6-a087-c937d21ec45a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.946718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.947320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.947600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.947873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.948515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.948705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 642/1280] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.949612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.950136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.959960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4129945-88eb-4d03-9bb7-4728b30310d8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.961618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 639/1281] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.962503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.964899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.965440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.965757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.966028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.966666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.968249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.974833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce54-6495-4f36-a1e3-05bc1f2e7565 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:39.978822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 643/1282] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.979525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:39.979637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.980108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:39.980384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:39.980653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:39.981288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:39.983005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:39.992949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 640/1283] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:39.993800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:39.997468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:40.003611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a16e3-47f2-400c-b620-d133ebb58585 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.009712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.010364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.010643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.010913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] PATH_INFO: `/v3/projects/b24f0a58904048f1b52629c100a44c84/users/dffb0949a6194440bfbd2940d43402ac/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.026517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24f0a58904048f1b52629c100a44c84, user_id=dffb0949a6194440bfbd2940d43402ac, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.028877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.042836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065ad4-fdee-4204-b965-85c589bb6821 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.043355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 641/1284] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:39 2022] PUT /identity/v3/projects/b24f0a58904048f1b52629c100a44c84/users/dffb0949a6194440bfbd2940d43402ac/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.044312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.102616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.103233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.103645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.103924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.112136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38391-59f5-4931-96f4-358ea3be8804 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.116868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.117527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.117836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.118108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] PATH_INFO: `/v3/projects/8bff67e3f28941918b46a18eb6c26c61/users/d0e6b5d82bf749608dbbb29fe346f825/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.134099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bff67e3f28941918b46a18eb6c26c61, user_id=d0e6b5d82bf749608dbbb29fe346f825, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.136733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.149980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 642/1285] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:40 2022] PUT /identity/v3/projects/8bff67e3f28941918b46a18eb6c26c61/users/d0e6b5d82bf749608dbbb29fe346f825/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.150771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.169926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.171415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.181380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 644/1286] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.182170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.193635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a62f1-2f85-49cc-8d58-3235ea731bf3 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.218063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb3bec-85b5-4b60-b5ad-4f569069eb93 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.230482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.231294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.231670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.232067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.232806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.234846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.250347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:40.265653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.266168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 643/1287] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:40.267062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.270244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.270592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.273460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] PATH_INFO: `/v3/projects/5aa86125d1e843208c394cb6e2ae0c49/users/80168c16c0ca44cb86c9691fda4aab5e/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.291674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa86125d1e843208c394cb6e2ae0c49, user_id=80168c16c0ca44cb86c9691fda4aab5e, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.294408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.308504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 645/1288] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:40 2022] PUT /identity/v3/projects/5aa86125d1e843208c394cb6e2ae0c49/users/80168c16c0ca44cb86c9691fda4aab5e/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.312470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.315563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:40.331137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ccdbb-7258-463d-a819-7396ddac1178 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.375147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662946b-e2d7-4ea9-8888-43fc4955d7b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.380188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.381193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.381786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.382241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] PATH_INFO: `/v3/projects/7ccb376d0c0c4ca3bcf0134573c2da2b/users/bf24539086724dc4aa3d5c569a47e85a/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.386219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.386889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.387164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.387433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] PATH_INFO: `/v3/projects/cd24622c0af44ecc834b62750ff485c3/users/708cda0dbbb94d6ebda3768518539c15/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.397689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccb376d0c0c4ca3bcf0134573c2da2b, user_id=bf24539086724dc4aa3d5c569a47e85a, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.400385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.402281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd24622c0af44ecc834b62750ff485c3, user_id=708cda0dbbb94d6ebda3768518539c15, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.405911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e9059-1fe2-40b6-ab2f-1db638af9666 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.415883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 646/1289] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:40 2022] PUT /identity/v3/projects/7ccb376d0c0c4ca3bcf0134573c2da2b/users/bf24539086724dc4aa3d5c569a47e85a/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.416848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.422787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 644/1290] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:40 2022] PUT /identity/v3/projects/cd24622c0af44ecc834b62750ff485c3/users/708cda0dbbb94d6ebda3768518539c15/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.422787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841c38-967d-419c-abd5-cf842162d4a5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.422787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841c38-967d-419c-abd5-cf842162d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.422787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841c38-967d-419c-abd5-cf842162d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.451618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0a841c38-967d-419c-abd5-cf842162d4a5 None None] MFA Rules not processed for user `dffb0949a6194440bfbd2940d43402ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.452992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0a841c38-967d-419c-abd5-cf842162d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.482263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42603b6-483a-4f00-ace4-0939deb314b5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.519439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 645/1291] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.520700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.520988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.521367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.540716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.542018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.545887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.546647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.546982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.547257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] PATH_INFO: `/v3/projects/2339fbb287cb41adbfb272868d82c8f0/users/56dbff833b7f452a839852b02fb18672/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.550138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 646/1292] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.550843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.560618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860882-e040-42dc-943c-ff0470fc59e7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.567438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668038-4870-43d1-b083-75be6247905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.568079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668038-4870-43d1-b083-75be6247905c admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.568345 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668038-4870-43d1-b083-75be6247905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.568620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668038-4870-43d1-b083-75be6247905c admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.569256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668038-4870-43d1-b083-75be6247905c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.571221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668038-4870-43d1-b083-75be6247905c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.572451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2339fbb287cb41adbfb272868d82c8f0, user_id=56dbff833b7f452a839852b02fb18672, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.575195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.579462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:40.589895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 647/1293] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:40 2022] PUT /identity/v3/projects/2339fbb287cb41adbfb272868d82c8f0/users/56dbff833b7f452a839852b02fb18672/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:40.590726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.595516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 647/1294] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:40.597116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbbc2-5e95-4132-a6b6-b02980f1cc5e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.597423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbbc2-5e95-4132-a6b6-b02980f1cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.597736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbbc2-5e95-4132-a6b6-b02980f1cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.613479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:40.616670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cd4bbbc2-5e95-4132-a6b6-b02980f1cc5e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.617902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cd4bbbc2-5e95-4132-a6b6-b02980f1cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.658013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca94325-656b-4dd6-809d-203ac8285d9f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.661716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.662380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.662650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.662919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.680985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 648/1295] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.680985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828961-2d5b-44e6-afac-2487273b3539 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.680985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828961-2d5b-44e6-afac-2487273b3539 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.680985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3828961-2d5b-44e6-afac-2487273b3539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.698354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e3828961-2d5b-44e6-afac-2487273b3539 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.699560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e3828961-2d5b-44e6-afac-2487273b3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.707200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 649/1296] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.708383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.708741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.709453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.725037 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.726592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4be558-ae5c-425c-a8f2-f7af222724a2 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.731369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.732624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.735804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 648/1297] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.737023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95b61-0adc-4067-8256-0fe30d0f01c6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.737305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95b61-0adc-4067-8256-0fe30d0f01c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.737632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95b61-0adc-4067-8256-0fe30d0f01c6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.740961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 650/1298] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.741813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.743681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 649/1299] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:43:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:43:40.745309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.745568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.745915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.765335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.766597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.774625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 650/1300] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:40.775457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.786506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea49f6d-a3f3-454f-8bab-809df04c8189 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.793720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.794461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.794937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.795328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.796317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.798035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.810307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 651/1301] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:40.811699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.813536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.821963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6dd6-2518-44c0-8eef-fbdbee4ba71e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.825766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b61f-b55d-4430-9dc9-bad373a778d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.825893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.826429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.826701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.826969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.830289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.830962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.831413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.831658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.838459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.840125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.842005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.843682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eaabf-ff07-43b9-8634-f68a0ffd1008 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.850611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 651/1302] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.851488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.864014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c6eb-c95b-47af-aa7d-0bfc2c267532 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.865005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 652/1303] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.866247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.866535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.866807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.873681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.874313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.874587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.874859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.893976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.896834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.909058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 652/1304] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.910184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:40.924511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83e636-9057-4ce1-9da4-cf3f8f499a34 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:40.934140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:40.935051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:40.935364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:40.936910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:40.946806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:40.949823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:40.958868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:40.960469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:40.979090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 653/1305] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:40.980096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.004235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7d89-630d-45a1-b1f9-a8289992418d service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.013626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.016875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.017354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.017996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.043587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.049005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.079172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 654/1306] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:41.080696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.097624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29addbb-a84b-450c-9431-616f5311d04f service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.105247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.106432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.107202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.107494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] PATH_INFO: `/v3/projects/74f04a9e21504d6bb992b07b9dd68232/users/08ed7fecc675414fb2a291b8fb1c4677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.123680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 653/1307] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:41.132486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.138725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f04a9e21504d6bb992b07b9dd68232, user_id=08ed7fecc675414fb2a291b8fb1c4677, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.142975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.149806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0261b-dec2-474e-962c-574c80c232fc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.157626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.158661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.159188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.159577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.164331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 655/1308] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:41 2022] PUT /identity/v3/projects/74f04a9e21504d6bb992b07b9dd68232/users/08ed7fecc675414fb2a291b8fb1c4677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:41.170538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.180968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:41.220198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:41.290786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.293675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.310529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 654/1309] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:41.344429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488cc8-2b0c-4b4e-b5a6-c09cd956b138 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.352219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.352939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.353342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.354221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.355151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.357655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5e10-62ce-4b8f-ad90-32f14c587384 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.383452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 656/1310] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:41.387696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.412299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570c71-99bf-431b-80ed-592c12bdf3e5 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.424664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.428509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.428825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.429110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] PATH_INFO: `/v3/projects/74f04a9e21504d6bb992b07b9dd68232/users/08ed7fecc675414fb2a291b8fb1c4677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.449555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f04a9e21504d6bb992b07b9dd68232, user_id=08ed7fecc675414fb2a291b8fb1c4677, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.457504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.506831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 655/1311] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:41 2022] PUT /identity/v3/projects/74f04a9e21504d6bb992b07b9dd68232/users/08ed7fecc675414fb2a291b8fb1c4677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:41.508340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.508774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.509029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.588479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] MFA Rules not processed for user `08ed7fecc675414fb2a291b8fb1c4677`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:41.590614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:41.696492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 657/1312] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:41.711753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.801488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c64e2-074f-4503-963f-7e4ce48d6bce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:41.806861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:41.807471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:41.807750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:41.808021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:41.823675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:41.825514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d072dd-0cae-4043-94bd-b09484f2511b service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:41.839048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 656/1313] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:41.978142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:41.990157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08bb89-0829-4ae5-aacd-397c0497a6e5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:42.016843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:42.017871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.018226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.018567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.157842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:42.161630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa37045-ef91-4fe0-b7f9-f2094baae842 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:42.187000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 658/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:42.446262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.446575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.446860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.512743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284b6-5b50-4d8f-84d9-07f0625e523f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.513233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284b6-5b50-4d8f-84d9-07f0625e523f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.513336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284b6-5b50-4d8f-84d9-07f0625e523f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.514975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 659/1315] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:43:42.533606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491376-7934-4b1d-9736-740d2ba23585 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.534001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491376-7934-4b1d-9736-740d2ba23585 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.534176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491376-7934-4b1d-9736-740d2ba23585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.563493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] MFA Rules not processed for user `d0e6b5d82bf749608dbbb29fe346f825`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:42.564741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:42.593610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-74491376-7934-4b1d-9736-740d2ba23585 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:42.594890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-74491376-7934-4b1d-9736-740d2ba23585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:42.692251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:42.769083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 657/1316] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:42.773205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:42.811584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 660/1317] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:42.820587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be877-abd3-4a59-b9be-d8cb218e87a8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.820978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be877-abd3-4a59-b9be-d8cb218e87a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.821348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be877-abd3-4a59-b9be-d8cb218e87a8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.823241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 661/1318] 10.222.0.62 () {54 vars in 912 bytes} [Mon Oct 17 17:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:43:42.828598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.828986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.829396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.857720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:42.877160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:42.882416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:42.912654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 662/1319] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:42.922899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:42.925741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf378a-661b-4b00-9214-5ee9c4be6482 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:42.932665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:42.933441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.933871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.934210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.935341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01694-18c4-49d7-be09-e974615cf688 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:42.935460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:42.937568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb6d9-adf0-47b5-adac-34e2d1529994 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:42.939993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:42.940808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:42.941293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:42.941748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:42.963598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:42.965627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:42.993667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 663/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:43:43.004661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 658/1321] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:42 2022] POST /identity/v3/projects => generated 405 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:43.006838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.022453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44242-89df-402d-a560-31fb93241bd7 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.151018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.152112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.152619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.153056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.153904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.157949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.178222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c4b1-3a83-4fd6-8ded-206b8d531ac6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.178837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c4b1-3a83-4fd6-8ded-206b8d531ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.179216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c4b1-3a83-4fd6-8ded-206b8d531ac6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.187462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 659/1322] 10.222.0.62 () {54 vars in 912 bytes} [Mon Oct 17 17:43:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:43:43.198828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.199229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.199565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.233090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 664/1323] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:43 2022] POST /identity/v3/users => generated 309 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:43:43.237166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.244590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:43.246162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:43.263251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011af36-8ebe-468b-891a-394efbe5cea0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.270310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.270932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.271359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.271891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.273241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.275121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.302601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 665/1324] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:43.309568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.328320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4068-753d-4ac7-ac65-d273f8addce3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.346232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.347200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.347944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.348413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] PATH_INFO: `/v3/projects/fb2d060436d644dbbe50f6ee7828f065/users/717188c5716749a489f79752c6440f2a/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.372762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2d060436d644dbbe50f6ee7828f065, user_id=717188c5716749a489f79752c6440f2a, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.378470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.406632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 660/1325] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:43:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:43.412858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.419690 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 666/1326] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:43 2022] PUT /identity/v3/projects/fb2d060436d644dbbe50f6ee7828f065/users/717188c5716749a489f79752c6440f2a/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:43.423832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.549231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22238a-5d97-4849-8ff9-923b837d5cdd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.556693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371136-1bd4-40a8-a911-be8dbd631f51 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.556957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.558253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.558253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.558510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.559322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.563054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.567851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:43.600231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 667/1327] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:43.602845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:43.627204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304105-39f6-4a5f-b7df-2a9312dc9ae3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:43.633478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.635453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.636139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.636644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] PATH_INFO: `/v3/projects/fb2d060436d644dbbe50f6ee7828f065/users/717188c5716749a489f79752c6440f2a/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.640195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2d060436d644dbbe50f6ee7828f065, user_id=717188c5716749a489f79752c6440f2a, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.644321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.664763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 668/1328] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:43 2022] PUT /identity/v3/projects/fb2d060436d644dbbe50f6ee7828f065/users/717188c5716749a489f79752c6440f2a/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:43.694446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:43.695132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:43.695340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:43.695615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:43.736025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:43.845114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:43.847144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cb52e-8007-47ce-9719-035679f59306 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:43.868015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 661/1329] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:44.092489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:44.254916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757bf52-3ad1-47ec-ab15-8dd41661382a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:44.262085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:44.262733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:44.263009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:44.263263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] PATH_INFO: `/v3/users/dffb0949a6194440bfbd2940d43402ac` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:44.276953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffb0949a6194440bfbd2940d43402ac)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:44.277496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:44.389271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffb0949a6194440bfbd2940d43402ac'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.400354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffb0949a6194440bfbd2940d43402ac'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.426185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffb0949a6194440bfbd2940d43402ac'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.426967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffb0949a6194440bfbd2940d43402ac'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.444732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffb0949a6194440bfbd2940d43402ac'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.458454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 669/1330] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:44 2022] DELETE /identity/v3/users/dffb0949a6194440bfbd2940d43402ac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:44.463473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:44.464115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:44.464602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:44.510237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:44.520248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:44.545360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:44.547279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:44.702668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65383cdd-eee7-4fa1-a090-b2a558f27116 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:44.721653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 662/1331] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:44.730777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:44.734570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:44.736141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:44.736679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] PATH_INFO: `/v3/users/89724d7e1c394159956fd71a6e194e44` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:44.741996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89724d7e1c394159956fd71a6e194e44)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:44.746357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:44.748104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:44.755850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:44.796341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:44.920371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d9e25-7d4b-42b6-918a-c226ef199fa5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:44.928800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:44.930393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:44.931205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:44.933310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:44.940724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89724d7e1c394159956fd71a6e194e44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.952465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:44.955614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89724d7e1c394159956fd71a6e194e44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.961853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779033e-cd9d-41d3-9628-c74962fdd7db service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:44.988476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89724d7e1c394159956fd71a6e194e44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.990761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89724d7e1c394159956fd71a6e194e44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:44.992103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 663/1332] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:43:45.013701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89724d7e1c394159956fd71a6e194e44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:45.031308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 670/1333] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:44 2022] DELETE /identity/v3/users/89724d7e1c394159956fd71a6e194e44 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:43:45.035866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:45.036367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:45.036835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:45.071355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:45.072919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:45.167482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:45.191268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 664/1334] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:45.212961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:45.215097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:45.312913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8175-a99e-45fa-aa63-2549a343c5e1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:45.320106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:45.320799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:45.321134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:45.321411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:45.337765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:45.339346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f49ce6-105a-4282-bca1-2a0c4654e660 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:45.358872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 671/1335] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:46.547855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:46.550827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:46.579120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272402b7-81c5-4707-80f4-c36c71ebb09c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:46.594272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:46.596368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:46.600102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:46.601048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] PATH_INFO: `/v3/projects/b24f0a58904048f1b52629c100a44c84` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:46.609625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24f0a58904048f1b52629c100a44c84)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:46.615284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:46.775244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24f0a58904048f1b52629c100a44c84', 'request_id': 'req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:46.795144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24f0a58904048f1b52629c100a44c84', 'request_id': 'req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:46.806245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24f0a58904048f1b52629c100a44c84', 'request_id': 'req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:46.831983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] The token cache is being invalidate because project b24f0a58904048f1b52629c100a44c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:46.832431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:46.834119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1d618d1d-9f2a-4e4d-9a54-b60318b4c535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:46.842738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 665/1336] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:46 2022] DELETE /identity/v3/projects/b24f0a58904048f1b52629c100a44c84 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:46.844116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:46.845388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:46.845388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:46.890701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:46.891731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:47.018648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 672/1337] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:47.026764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.027244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.027686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.036702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.038865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:47.072211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d416c65-b313-44eb-b576-2090925f98b2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:47.087591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:47.089070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:47.091164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.091164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.091164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] PATH_INFO: `/v3/projects/6de02a13c7004941b3bbec1330a38490` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.093798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:47.096738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de02a13c7004941b3bbec1330a38490)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:47.119605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:43:47.119605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Oct 17 17:43:47.119605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: Oct 17 17:43:47.120390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 666/1338] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:47.125066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.127394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:47.146905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fbf76-44f9-453f-ae1d-64a57e9a313e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:47.166669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:47.166923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:47.171957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.176416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.177735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.179830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:47.182867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:47.189498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:47.214961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 667/1339] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:43:47.219300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.235031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a9f2e-9b44-40bb-b637-dcf314d8c205 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:47.261876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de02a13c7004941b3bbec1330a38490', 'request_id': 'req-6d9767c5-f73c-4092-90ea-144e62c13be4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.275885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de02a13c7004941b3bbec1330a38490', 'request_id': 'req-6d9767c5-f73c-4092-90ea-144e62c13be4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.294638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de02a13c7004941b3bbec1330a38490', 'request_id': 'req-6d9767c5-f73c-4092-90ea-144e62c13be4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.395816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] The token cache is being invalidate because project 6de02a13c7004941b3bbec1330a38490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:47.397929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.403500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.412813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 673/1340] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:47 2022] DELETE /identity/v3/projects/6de02a13c7004941b3bbec1330a38490 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:43:47.415210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.426045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:47.434451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:47.435296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.435729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.436216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.437125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:47.446129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:47.487767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9767c5-f73c-4092-90ea-144e62c13be4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:47.515270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:47.516030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.516332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.516446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] PATH_INFO: `/v3/users/029f1c0d8911480fabf4adcdfb4ee522` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.519698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029f1c0d8911480fabf4adcdfb4ee522)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:47.529864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:47.553322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 668/1341] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:47 2022] POST /identity/v3/projects => generated 403 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:43:47.557066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.567485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:47.685294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029f1c0d8911480fabf4adcdfb4ee522'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.694852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:47.706818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029f1c0d8911480fabf4adcdfb4ee522'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.754080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029f1c0d8911480fabf4adcdfb4ee522'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.756133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029f1c0d8911480fabf4adcdfb4ee522'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.768580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7370-9145-4006-af66-8cbb5fe42600 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:47.777479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029f1c0d8911480fabf4adcdfb4ee522'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:47.787905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:47.788567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:47.789771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:47.789771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:47.790378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:47.796903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:47.801036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 674/1342] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:47 2022] DELETE /identity/v3/users/029f1c0d8911480fabf4adcdfb4ee522 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:47.851034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:47.851917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 669/1343] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:47 2022] POST /identity/v3/users => generated 302 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:47.854624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:48.045198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd27f-65de-47f0-b50d-aac5ad94cc23 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:48.063809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:48.064635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:48.065323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:48.065779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:48.066583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:48.077692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:48.095901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 675/1344] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:48.101196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:48.124415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6b7d-22ea-4ebe-8bc0-498d01521777 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:48.150384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:48.153375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:48.154988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:48.155556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:48.159332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:48.166125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fc66c-483f-4bcb-a5e5-7fdac033fe0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:48.194753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 670/1345] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:48.199234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:48.214131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4888a-fa0c-468d-994a-5ceb50f6799e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:48.229569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:48.230318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:48.230591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:48.230912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] PATH_INFO: `/v3/projects/6c185caec5d24c119a4347f0bfc8161b/users/62a6a67c38e747428f4281dd0acda6d7/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:48.270461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c185caec5d24c119a4347f0bfc8161b, user_id=62a6a67c38e747428f4281dd0acda6d7, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:48.273374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:48.280319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:48.320469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 676/1346] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:48 2022] PUT /identity/v3/projects/6c185caec5d24c119a4347f0bfc8161b/users/62a6a67c38e747428f4281dd0acda6d7/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:48.333042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:48.333390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:48.333818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:48.409346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] MFA Rules not processed for user `62a6a67c38e747428f4281dd0acda6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:48.410650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:48.642134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 671/1347] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:48.646679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:48.823636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5e199-8517-4898-9f2a-9661906d81c9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:48.831909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:48.832785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:48.833167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:48.834145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:48.834964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:48.837540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:48.897329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 677/1348] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:48 2022] POST /identity/v3/projects => generated 403 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:48.899753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:48.921479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5005-b58e-4706-8d77-b40bc1f15911 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:49.050151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:49.050824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.051104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.051372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.052010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:49.054203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:49.091408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:49.093218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 672/1349] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:48 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:49.110016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079c01-4394-420c-9688-4ef2b044e40b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:49.127334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:49.127982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.128260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.128531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.129187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:49.131264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:49.155067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 678/1350] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:43:49.156508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:49.172224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2821e-137f-453f-9857-79b4715c07dd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:49.193083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:49.193843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.194108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.194385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] PATH_INFO: `/v3/projects/733b3163a3d042eca61a6e34a401d939/users/dd2176de33764dac801c599880ee096b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.225953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733b3163a3d042eca61a6e34a401d939, user_id=dd2176de33764dac801c599880ee096b, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:49.236812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935167b-e54c-4b91-93fe-592f94119097 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:49.279649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 673/1351] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:49 2022] PUT /identity/v3/projects/733b3163a3d042eca61a6e34a401d939/users/dd2176de33764dac801c599880ee096b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:49.282239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:49.300772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99808e-4bb8-4deb-b564-699de4211923 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:49.330198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.330556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.330938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.423708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] MFA Rules not processed for user `717188c5716749a489f79752c6440f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:49.429253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:49.456437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:49.466032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:49.466687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.469669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.470006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.470667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:49.478727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:49.525936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 679/1352] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:49.530232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:49.560786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c13e-799d-4d96-8e27-c123a5b1a839 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:49.565924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:49.566610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.566894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.567170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] PATH_INFO: `/v3/projects/733b3163a3d042eca61a6e34a401d939/users/dd2176de33764dac801c599880ee096b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.574093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733b3163a3d042eca61a6e34a401d939, user_id=dd2176de33764dac801c599880ee096b, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:49.577186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b9730-b7c6-4a99-8c3c-5f85056ea766 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:49.604174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 680/1353] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:49 2022] PUT /identity/v3/projects/733b3163a3d042eca61a6e34a401d939/users/dd2176de33764dac801c599880ee096b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:49.614573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:49.615074 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:49.615578 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:49.642809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 674/1354] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:49.683089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] MFA Rules not processed for user `dd2176de33764dac801c599880ee096b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:49.684392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:49.757928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:49.856915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 681/1355] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:49.870674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:49.872314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:50.061569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bbf9c-7e37-4d94-8888-d025f0a66ee4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:50.162570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:50.163768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:50.191175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:50.192112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.192606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.193156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.208575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:50.210827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:50.241481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 675/1356] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:50.333117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ea77-5123-4ae5-b691-8ca5720c493a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:50.349210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:50.349958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.350240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.350520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] PATH_INFO: `/v3/projects/2c4b324171dc4defbffb3a14f3e26170` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.356437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4b324171dc4defbffb3a14f3e26170)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:50.359547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:50.504392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4b324171dc4defbffb3a14f3e26170', 'request_id': 'req-406a956b-fe76-4a4e-8177-cdff003e944d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.521837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:50.533427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4b324171dc4defbffb3a14f3e26170', 'request_id': 'req-406a956b-fe76-4a4e-8177-cdff003e944d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.562128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4b324171dc4defbffb3a14f3e26170', 'request_id': 'req-406a956b-fe76-4a4e-8177-cdff003e944d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.582058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] The token cache is being invalidate because project 2c4b324171dc4defbffb3a14f3e26170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:50.582350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.584309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-406a956b-fe76-4a4e-8177-cdff003e944d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.585346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13142a1-68da-4191-9ffa-362d68d66522 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:50.585993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 682/1357] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:50 2022] DELETE /identity/v3/projects/2c4b324171dc4defbffb3a14f3e26170 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:50.591708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e01fe-b872-4c27-a816-178877ae7c3e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.592064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e01fe-b872-4c27-a816-178877ae7c3e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.592341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e01fe-b872-4c27-a816-178877ae7c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.635866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6d7e01fe-b872-4c27-a816-178877ae7c3e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:50.645076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6d7e01fe-b872-4c27-a816-178877ae7c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:50.745030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:50.746762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.746762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.746762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] PATH_INFO: `/v3/users/62a6a67c38e747428f4281dd0acda6d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.749948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a6a67c38e747428f4281dd0acda6d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:50.752553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 17:43:50.752553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Oct 17 17:43:50.752553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: Oct 17 17:43:50.755464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:50.763583 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:50.768415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 683/1358] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:50.777435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.777803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.778002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.806186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:50.825336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:50.829457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:50.857012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 684/1359] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:50.858697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:50.885295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14346b9-b138-4135-979f-2e5cb81da1cf None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:50.900794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:50.901809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:50.903331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:50.903331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:50.904651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:50.905235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:50.910605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:50.935744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a6a67c38e747428f4281dd0acda6d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.939718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a6a67c38e747428f4281dd0acda6d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.959542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 685/1360] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:50.963862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:50.968927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a6a67c38e747428f4281dd0acda6d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:50.975288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:51.007469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187c93-7a2e-454d-a0c2-02b329c3b267 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.020407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a6a67c38e747428f4281dd0acda6d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:51.024243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.024628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.024909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.025180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.025865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.035640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.057747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-903960f8-f851-4856-ae76-7ba3dfd99805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a6a67c38e747428f4281dd0acda6d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:51.077075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 676/1361] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:50 2022] DELETE /identity/v3/users/62a6a67c38e747428f4281dd0acda6d7 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:51.082393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.082870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.082983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.126291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 686/1362] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:50 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:51.128048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:51.148601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:51.154158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:51.257113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c50ee-1764-40c2-8866-e95425e5ab10 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.277761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.281086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.281679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.281969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.299220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 677/1363] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:51.299590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.301796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.341710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:51.343387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:51.360249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 687/1364] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:51 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:51.364798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:51.394790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f475dd-6bf0-4565-a4ff-52df644c7ccf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.417521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.418180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.418448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.418718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.420004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.422231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.463432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 688/1365] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:51.464251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:51.485091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4390-3b36-4246-9a88-d26066a5941c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.501960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.503232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.503232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.503492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.503967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.505831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.510419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a7408-c997-4553-bedc-33d4ef104942 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.515210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.515848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.516126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.516399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.536590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 689/1366] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:51.542378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:51.548542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.555125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cbb88-6dd0-4365-b7ab-57951cb865aa service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.574912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbdf09-00c7-44bf-bd40-b6b9b9577c55 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:51.599610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 678/1367] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:51.604596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:51.605366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.605668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.605945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] PATH_INFO: `/v3/projects/462fc4468094423b80b29cdfd3d5046e/users/dc312f139b6941f4accc36483faf6a88/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.627852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462fc4468094423b80b29cdfd3d5046e, user_id=dc312f139b6941f4accc36483faf6a88, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:51.630595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:51.679862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:51.680336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:51.680805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:51.687184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 690/1368] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:51 2022] PUT /identity/v3/projects/462fc4468094423b80b29cdfd3d5046e/users/dc312f139b6941f4accc36483faf6a88/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:51.745262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] MFA Rules not processed for user `dc312f139b6941f4accc36483faf6a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:51.746692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:51.760348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:51.958532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 679/1369] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:51.963069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.035502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.037608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:52.129778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d2643-b131-4381-bce1-d5bf1d418574 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.144041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.144977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.145477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.145992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.146894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:52.158219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:52.204287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd3bc9-25b9-420f-94bd-4dad3dfad902 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.214189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:52.218054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.219027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.219510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.219990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] PATH_INFO: `/v3/users/f85377460b0a4e6381d7597f0c59082b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.223162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85377460b0a4e6381d7597f0c59082b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:52.228962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:52.247954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 691/1370] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:51 2022] POST /identity/v3/projects => generated 367 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:52.249691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.334431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85377460b0a4e6381d7597f0c59082b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:52.335608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85377460b0a4e6381d7597f0c59082b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:52.353025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85377460b0a4e6381d7597f0c59082b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:52.372784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85377460b0a4e6381d7597f0c59082b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:52.392703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1764-6d2c-4d46-b44e-c0fc7e8518ea admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.394605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4df6aa3f-fc1f-4370-abfb-7b48fbc9b0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85377460b0a4e6381d7597f0c59082b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:52.399689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.401391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.401897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.402406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.403288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:52.407637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:52.424061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 680/1371] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:52 2022] DELETE /identity/v3/users/f85377460b0a4e6381d7597f0c59082b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:52.428766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.429058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.429331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.459321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 692/1372] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:52 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:52.465932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.471980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:52.479088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:52.480312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:52.539416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502db9-c6d6-4866-bc25-ee909180e0d1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.559902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:52.645098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 681/1373] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:52.686271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.686920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.687208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.687482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.688214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:52.691927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:52.702842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.704654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:52.711138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 693/1374] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:52.712462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.740408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56923d16-1a78-4ad3-8eae-69614b2f0590 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.758879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.759540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.759868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.760197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] PATH_INFO: `/v3/projects/42fca2f434f24bd7a909e67cb889503b/users/3b047975c2a14619a3c3653a9ee8cc45/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.794185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fca2f434f24bd7a909e67cb889503b, user_id=3b047975c2a14619a3c3653a9ee8cc45, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:52.797176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549ecfe-8154-4be1-b91d-a39c8dafd0b0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:52.826932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 694/1375] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:52 2022] PUT /identity/v3/projects/42fca2f434f24bd7a909e67cb889503b/users/3b047975c2a14619a3c3653a9ee8cc45/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:52.830046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737508-9b02-4fba-8483-8cea44b5038a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.830046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737508-9b02-4fba-8483-8cea44b5038a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.830403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737508-9b02-4fba-8483-8cea44b5038a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.833543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 695/1376] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:43:52.834487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737508-9b02-4fba-8483-8cea44b5038a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:52.839810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13096e-4f9c-436d-a714-b491e08dc47f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:52.983287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:52.984074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:52.984360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:52.984631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:52.994800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:53.011316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737508-9b02-4fba-8483-8cea44b5038a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.029351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.030077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.030355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.031133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.032025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.034072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6a3a-ad4f-480a-8463-1b5b5f80c3e2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.050125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 696/1377] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:53.057399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180af0-b2ea-43e0-91c2-9742ff0c4e8d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.057857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180af0-b2ea-43e0-91c2-9742ff0c4e8d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.058144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180af0-b2ea-43e0-91c2-9742ff0c4e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.082566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1e180af0-b2ea-43e0-91c2-9742ff0c4e8d None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:53.083882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1e180af0-b2ea-43e0-91c2-9742ff0c4e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.128017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.129516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.148598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 682/1378] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:43:53.149463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:53.167186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef25ef-673f-4f88-adbc-a39ad93bfea1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.179728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 697/1379] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:43:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:53.182089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.182789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.183070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.183348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] PATH_INFO: `/v3/projects/42fca2f434f24bd7a909e67cb889503b/users/3b047975c2a14619a3c3653a9ee8cc45/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.185359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fca2f434f24bd7a909e67cb889503b, user_id=3b047975c2a14619a3c3653a9ee8cc45, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.188141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.218337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 683/1380] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:53 2022] PUT /identity/v3/projects/42fca2f434f24bd7a909e67cb889503b/users/3b047975c2a14619a3c3653a9ee8cc45/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:53.230140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.230440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.230720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.235496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:53.237246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.298432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:53.320414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] MFA Rules not processed for user `3b047975c2a14619a3c3653a9ee8cc45`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:53.322846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.389299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93b4a-ff71-49d5-9475-e91707806383 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.403593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.404238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.404521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.404797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.423813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.425619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.462124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 684/1381] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:43:53.468451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 698/1382] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:53.481477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:53.482892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.624688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21592c-f86a-488e-aa72-034ba144dec8 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.636579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.637229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.637514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.637817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.660382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.661999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.681308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 685/1383] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:53.754648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:53.756322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:53.759006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.760760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.796116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58502fa-cd57-4de7-b836-4d217b0e11f8 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.808283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.809327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.809732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.810240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.816298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:53.950179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc5eca-47f8-4f98-84c5-317491027f60 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:53.965864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31731-e940-4052-9755-883760128289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:53.967022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31731-e940-4052-9755-883760128289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:53.967828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31731-e940-4052-9755-883760128289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:53.968990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31731-e940-4052-9755-883760128289 admin admin] PATH_INFO: `/v3/projects/6c185caec5d24c119a4347f0bfc8161b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:53.973291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c31731-e940-4052-9755-883760128289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c185caec5d24c119a4347f0bfc8161b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.976983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c31731-e940-4052-9755-883760128289 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:53.988830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:53.992786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:54.027905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 686/1384] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:54.035407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:54.084205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c185caec5d24c119a4347f0bfc8161b', 'request_id': 'req-21c31731-e940-4052-9755-883760128289'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.094801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c185caec5d24c119a4347f0bfc8161b', 'request_id': 'req-21c31731-e940-4052-9755-883760128289'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.103175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c185caec5d24c119a4347f0bfc8161b', 'request_id': 'req-21c31731-e940-4052-9755-883760128289'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.120614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] The token cache is being invalidate because project 6c185caec5d24c119a4347f0bfc8161b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:54.121887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.122592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-21c31731-e940-4052-9755-883760128289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.130304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:54.132219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 699/1385] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:53 2022] DELETE /identity/v3/projects/6c185caec5d24c119a4347f0bfc8161b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:54.146624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5717de-4d1d-4f02-831b-92d67eff450d service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:54.268759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:54.287032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:54.288090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:54.288537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:54.292332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] PATH_INFO: `/v3/users/dd2176de33764dac801c599880ee096b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:54.293863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2176de33764dac801c599880ee096b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:54.295836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:54.412949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2176de33764dac801c599880ee096b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.413796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2176de33764dac801c599880ee096b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.438799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2176de33764dac801c599880ee096b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.478955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2176de33764dac801c599880ee096b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.495854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2176de33764dac801c599880ee096b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:54.509365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 687/1386] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:54 2022] DELETE /identity/v3/users/dd2176de33764dac801c599880ee096b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:55.506373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31731-e940-4052-9755-883760128289 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:55.513729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-21c31731-e940-4052-9755-883760128289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:55.546804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31731-e940-4052-9755-883760128289 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:55.716278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:55.716862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:55.717136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:55.717557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] PATH_INFO: `/v3/projects/9dd41804230f4f3fb9645902c8cd514e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:55.719120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd41804230f4f3fb9645902c8cd514e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:55.721946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:55.825232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd41804230f4f3fb9645902c8cd514e', 'request_id': 'req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:55.838141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd41804230f4f3fb9645902c8cd514e', 'request_id': 'req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:55.850420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd41804230f4f3fb9645902c8cd514e', 'request_id': 'req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:55.891356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] The token cache is being invalidate because project 9dd41804230f4f3fb9645902c8cd514e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:55.891662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:55.894330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:55.899649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 700/1387] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:55 2022] DELETE /identity/v3/projects/9dd41804230f4f3fb9645902c8cd514e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:55.903872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:55.905373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:55.937490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8273-425f-415b-8f80-20e8353a271c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:55.989132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:55.994679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:56.125894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:56.126661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.127100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.127467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] PATH_INFO: `/v3/users/08ed7fecc675414fb2a291b8fb1c4677` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.132629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:56.147276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ed7fecc675414fb2a291b8fb1c4677)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:56.157779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:56.220131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045e0f-46d0-40d7-8931-6eb4e7b205cb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:56.243136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:56.244624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.244915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.245682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] PATH_INFO: `/v3/projects/733b3163a3d042eca61a6e34a401d939` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.252014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733b3163a3d042eca61a6e34a401d939)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:56.254140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:56.317769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ed7fecc675414fb2a291b8fb1c4677'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.319187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ed7fecc675414fb2a291b8fb1c4677'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.332283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ed7fecc675414fb2a291b8fb1c4677'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.362723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ed7fecc675414fb2a291b8fb1c4677'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.376751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:56.410375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ed7fecc675414fb2a291b8fb1c4677'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.437315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733b3163a3d042eca61a6e34a401d939', 'request_id': 'req-22371447-b019-4ad7-96b3-fee857d65430'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.460482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 688/1388] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:55 2022] DELETE /identity/v3/users/08ed7fecc675414fb2a291b8fb1c4677 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:56.463941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:56.467077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:56.477848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733b3163a3d042eca61a6e34a401d939', 'request_id': 'req-22371447-b019-4ad7-96b3-fee857d65430'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.497627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733b3163a3d042eca61a6e34a401d939', 'request_id': 'req-22371447-b019-4ad7-96b3-fee857d65430'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.530441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] The token cache is being invalidate because project 733b3163a3d042eca61a6e34a401d939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:56.532251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.533498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22371447-b019-4ad7-96b3-fee857d65430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.542430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 701/1389] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:55 2022] DELETE /identity/v3/projects/733b3163a3d042eca61a6e34a401d939 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:43:56.546793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00930-5f88-4416-a89e-f1e6029fffa4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.547079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00930-5f88-4416-a89e-f1e6029fffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.547988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00930-5f88-4416-a89e-f1e6029fffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.601441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1bd00930-5f88-4416-a89e-f1e6029fffa4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:56.606547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1bd00930-5f88-4416-a89e-f1e6029fffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:56.682519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ecca5-e7f9-4b51-88fd-095794ef169a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:56.691553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:56.692066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.692476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.692736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] PATH_INFO: `/v3/users/d0e6b5d82bf749608dbbb29fe346f825` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.701385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e6b5d82bf749608dbbb29fe346f825)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:56.703435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:56.794075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 702/1390] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:56.804051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.804381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.804628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.855007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:56.856222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:56.860312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e6b5d82bf749608dbbb29fe346f825'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.861398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e6b5d82bf749608dbbb29fe346f825'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.865872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 703/1391] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:56.872371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:56.878452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e6b5d82bf749608dbbb29fe346f825'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.892692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2533609-989e-4237-b334-20d5aef4ecc7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:56.902704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:56.903335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:56.903608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:56.903879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:56.904653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:43:56.905055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:56.906775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:56.925838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e6b5d82bf749608dbbb29fe346f825'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.937163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 704/1392] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:43:56.938213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:56.942495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:56.949203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84b617c4-7c1c-4770-86d3-ea13c489e125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e6b5d82bf749608dbbb29fe346f825'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:56.968318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 689/1393] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:56 2022] DELETE /identity/v3/users/d0e6b5d82bf749608dbbb29fe346f825 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:56.996924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88f-7965-47d4-8234-43a307388e88 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:57.000243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.000535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.000811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.148207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] MFA Rules not processed for user `80168c16c0ca44cb86c9691fda4aab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:57.148207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:57.152011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:57.182479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:57.183116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.183398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.183673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.187786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:57.200499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:57.282385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 705/1394] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:56 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:57.283813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:57.349798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 690/1395] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:43:57.364629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:57.366665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:57.377267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:57.480278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ce6a-ba84-4b33-87d5-66a53728febe admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:57.496225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:57.496871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.497150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.497416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.511611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:57.523699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:57.571231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 706/1396] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:57 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:57.573114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:57.576036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:57.596070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ae2c-70e8-4733-b636-127a073ffeb2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:57.602318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:57.603277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.603768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.604253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] PATH_INFO: `/v3/projects/8bff67e3f28941918b46a18eb6c26c61` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.605722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bff67e3f28941918b46a18eb6c26c61)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:57.608105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:57.614006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3ea49-9579-4f10-84bb-356be801ee0b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:57.737961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bff67e3f28941918b46a18eb6c26c61', 'request_id': 'req-5c553718-e3c0-4f82-b2e2-b867d36522e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:57.759990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bff67e3f28941918b46a18eb6c26c61', 'request_id': 'req-5c553718-e3c0-4f82-b2e2-b867d36522e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:57.771249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bff67e3f28941918b46a18eb6c26c61', 'request_id': 'req-5c553718-e3c0-4f82-b2e2-b867d36522e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:57.805780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:57.806463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] The token cache is being invalidate because project 8bff67e3f28941918b46a18eb6c26c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:43:57.806767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:57.806889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.807297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.807710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.812618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5c553718-e3c0-4f82-b2e2-b867d36522e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:57.814742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 707/1397] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:43:57 2022] DELETE /identity/v3/projects/8bff67e3f28941918b46a18eb6c26c61 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:57.818930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:57.819215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:57.819491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:57.891644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] MFA Rules not processed for user `708cda0dbbb94d6ebda3768518539c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:57.893973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:57.951111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:57.952451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:57.962228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:58.008452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 691/1398] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:58.012762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:58.047449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db49f-d15d-4a71-8c87-f33970936fa5 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:58.068008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 708/1399] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:58.068677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:58.070113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.159180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:58.203653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43266916-7af6-4b09-9e34-e78bee1ff759 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:58.209981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:58.210974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.211263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.211534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] PATH_INFO: `/v3/users/717188c5716749a489f79752c6440f2a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.216234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] RBAC: Authorizing `identity:delete_user(user_id=717188c5716749a489f79752c6440f2a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:58.227299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:58.235634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:58.236272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.236566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.236842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.237954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:58.240010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b56a7-92f8-45ea-afb4-13fcbbb3afb7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:58.297151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 692/1400] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:58.303201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.303625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.303919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.339136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] MFA Rules not processed for user `708cda0dbbb94d6ebda3768518539c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:58.340438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.354527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717188c5716749a489f79752c6440f2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:58.365109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 693/1401] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:58.365831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:58.367267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.383554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717188c5716749a489f79752c6440f2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:58.403239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b45c1-6d6f-4415-83f1-14572196fda9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:58.410155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:58.411246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.411885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.412455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.413291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:58.415218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:58.415489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717188c5716749a489f79752c6440f2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:58.417284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717188c5716749a489f79752c6440f2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:58.440031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717188c5716749a489f79752c6440f2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:58.458541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 694/1402] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:58.460378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:58.463758 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.466790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 709/1403] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:58 2022] DELETE /identity/v3/users/717188c5716749a489f79752c6440f2a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:58.470016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:58.477185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.580260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69bbe3-f1e8-4757-bade-5c7d805486de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:58.664142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:58.664142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.664142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.667468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:58.675308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.681832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:58.707792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e37474-cce9-4fa7-8315-979a924e257e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:58.727219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:58.728998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.729724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.730320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] PATH_INFO: `/v3/projects/e5e2bfab9cd048d8b67bafd8c89e8b1d/users/c91884dcc0824d0ba11db5fd540aa2d4/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.754012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e2bfab9cd048d8b67bafd8c89e8b1d, user_id=c91884dcc0824d0ba11db5fd540aa2d4, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:58.765568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1434cf-b951-473c-9d12-2072c8a0923b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:58.817639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 710/1404] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:58 2022] PUT /identity/v3/projects/e5e2bfab9cd048d8b67bafd8c89e8b1d/users/c91884dcc0824d0ba11db5fd540aa2d4/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:43:58.822085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:58.822530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:58.823077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:58.843543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:58.872542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:58.875515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:58.910459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 695/1405] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:43:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:43:58.937671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] MFA Rules not processed for user `c91884dcc0824d0ba11db5fd540aa2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:58.939343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:59.218229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 711/1406] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:43:59.219359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:59.249801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de302-694e-46b3-8aa9-bba915ff50e2 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:59.286455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:59.288063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:59.506023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:59.507722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.508119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.509638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:59.509955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:59.512343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:59.527798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749aba4-dea6-4185-b3ce-eb858e1563c3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:59.539158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:59.540065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.540759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.541173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] PATH_INFO: `/v3/users/dc312f139b6941f4accc36483faf6a88` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:59.543825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc312f139b6941f4accc36483faf6a88)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:59.550970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:59.581457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 696/1407] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:43:59 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:59.584455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:59.676503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc312f139b6941f4accc36483faf6a88'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:59.697859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc312f139b6941f4accc36483faf6a88'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:59.707900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3838-c5d5-4d02-9c14-2103ae5caa1c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:59.714202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:59.715039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.715791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.716136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:59.717261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:59.719614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:59.736673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:59.754255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc312f139b6941f4accc36483faf6a88'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:59.756457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc312f139b6941f4accc36483faf6a88'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:59.760561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 697/1408] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:43:59 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:43:59.773674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:59.801747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c8de6adf-3b3f-41f3-b17e-874a618640ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc312f139b6941f4accc36483faf6a88'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:43:59.803255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58467b5-3b7d-4d1c-ae29-ba0458439e77 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:59.809284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:59.813229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.813780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.814196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:59.818218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 712/1409] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:43:59 2022] DELETE /identity/v3/users/dc312f139b6941f4accc36483faf6a88 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:43:59.820201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:43:59.823875 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:43:59.824290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.825919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.826213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:43:59.840652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 698/1410] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:43:59.845071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:43:59.847812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:59.877033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:43:59.888958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe5fd-773f-4ec4-ac9b-96bf2e198e68 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:43:59.889078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:43:59.975947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:43:59.986596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:43:59.987961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:43:59.988260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:43:59.988541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] PATH_INFO: `/v3/projects/26f71b71e79f421687dbd465633499e9/users/4c4716a9c854489a98e9e3cfbbeea52b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.008941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f71b71e79f421687dbd465633499e9, user_id=4c4716a9c854489a98e9e3cfbbeea52b, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:00.010347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 713/1411] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:00.016256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:00.051081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:00.051202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 699/1412] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:43:59 2022] PUT /identity/v3/projects/26f71b71e79f421687dbd465633499e9/users/4c4716a9c854489a98e9e3cfbbeea52b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:00.062675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:00.066419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.069798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83bfbc-f4a4-4431-a1d9-7fbd007a67c3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:00.257072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:00.258076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.258227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.258632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.259363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:00.260254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76262-e4ea-4096-a308-f058d50be975 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:00.261834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce65f4-b95c-453c-aa41-89d2235f2b6d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:00.274552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:00.275848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.278103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.278623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.299832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 714/1413] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:00.310394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80899-48b3-4642-b939-2901af1c0b5c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.312119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80899-48b3-4642-b939-2901af1c0b5c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.312350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80899-48b3-4642-b939-2901af1c0b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.326479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:00.331810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:00.382274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 700/1414] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:00.383447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:00.400935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-17d80899-48b3-4642-b939-2901af1c0b5c None None] MFA Rules not processed for user `bf24539086724dc4aa3d5c569a47e85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:00.402207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-17d80899-48b3-4642-b939-2901af1c0b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.422090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e094ea-9df2-44ec-b0bf-88871c352be0 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:00.435246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:00.436069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.436480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.436814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] PATH_INFO: `/v3/projects/26f71b71e79f421687dbd465633499e9/users/4c4716a9c854489a98e9e3cfbbeea52b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.446693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f71b71e79f421687dbd465633499e9, user_id=4c4716a9c854489a98e9e3cfbbeea52b, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:00.455748 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:00.492280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 701/1415] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:00 2022] PUT /identity/v3/projects/26f71b71e79f421687dbd465633499e9/users/4c4716a9c854489a98e9e3cfbbeea52b/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:00.493152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:00.503185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.561990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 715/1416] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:00.563452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.563841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.564218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.614106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:00.639795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] MFA Rules not processed for user `4c4716a9c854489a98e9e3cfbbeea52b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:00.641289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.656549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350450b0-5ec4-4d2d-8e2b-ae8a1e65ac65 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:00.669427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:00.670294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.671264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.671643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] PATH_INFO: `/v3/projects/fb2d060436d644dbbe50f6ee7828f065` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.678519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2d060436d644dbbe50f6ee7828f065)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:00.683136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:00.805447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2d060436d644dbbe50f6ee7828f065', 'request_id': 'req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:00.823307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 716/1417] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:00.823307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:00.823307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.824543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2d060436d644dbbe50f6ee7828f065', 'request_id': 'req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:00.832727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2d060436d644dbbe50f6ee7828f065', 'request_id': 'req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:00.845840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:00.855933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] The token cache is being invalidate because project fb2d060436d644dbbe50f6ee7828f065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:00.857856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:00.861133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c2fa341-f7c6-48f6-9fb6-0bed4a18dd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:00.867443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 702/1418] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:00 2022] DELETE /identity/v3/projects/fb2d060436d644dbbe50f6ee7828f065 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:00.867443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:00.868682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:00.869610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:00.940745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] MFA Rules not processed for user `56dbff833b7f452a839852b02fb18672`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:00.943945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:00.979054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92061-a5c7-41ab-b061-2dd36b5f72be None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:01.117035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 703/1419] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:01.127114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:01.133723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.146830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:01.147457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.147734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.148003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.153363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.204283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:01.246608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:01.249082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b93e-a61b-470b-82d4-e7a6f500bae6 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:01.263728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 717/1420] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:01.265663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260ad7-bbbe-4771-a564-ccee2ffc1e57 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.266295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260ad7-bbbe-4771-a564-ccee2ffc1e57 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.267368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260ad7-bbbe-4771-a564-ccee2ffc1e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.271809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0bae6-c786-4fe5-ba68-b3681a5d5dde None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:01.283784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:01.284555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.284911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.285345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.289287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.297697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-81260ad7-bbbe-4771-a564-ccee2ffc1e57 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:01.299211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-81260ad7-bbbe-4771-a564-ccee2ffc1e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.424582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:01.426893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294ced-799e-463a-ab70-0d7bc6618e5d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:01.447114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 718/1421] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:01.450543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.450820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.453294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.454760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 719/1422] 10.222.0.62 () {54 vars in 912 bytes} [Mon Oct 17 17:44:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:44:01.457846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:01.469692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.489883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 704/1423] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:01.493542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2eab-c385-4857-a5f5-b7c9120c05ac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.494706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2eab-c385-4857-a5f5-b7c9120c05ac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.494999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f2eab-c385-4857-a5f5-b7c9120c05ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.522095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e22f2eab-c385-4857-a5f5-b7c9120c05ac None None] MFA Rules not processed for user `56dbff833b7f452a839852b02fb18672`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:01.523805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e22f2eab-c385-4857-a5f5-b7c9120c05ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.526016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb2a8-3eae-4851-8165-b1c95742f43e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:01.541622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 705/1424] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:01.543055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c487-6371-4b6e-ab5c-0394d9d8f5fa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.543427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c487-6371-4b6e-ab5c-0394d9d8f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.543702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c487-6371-4b6e-ab5c-0394d9d8f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.550215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:01.552996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.553915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.555105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] PATH_INFO: `/v3/projects/74f04a9e21504d6bb992b07b9dd68232` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.558967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f04a9e21504d6bb992b07b9dd68232)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:01.563026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:01.591400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4d15c487-6371-4b6e-ab5c-0394d9d8f5fa None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:01.592683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4d15c487-6371-4b6e-ab5c-0394d9d8f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.608251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 706/1425] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:01.609728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.610089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.610420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.698516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:01.699971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.706741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f04a9e21504d6bb992b07b9dd68232', 'request_id': 'req-ec883ae1-e5b3-48e7-8069-b0180db59f50'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:01.723209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:01.726559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f04a9e21504d6bb992b07b9dd68232', 'request_id': 'req-ec883ae1-e5b3-48e7-8069-b0180db59f50'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:01.733847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f04a9e21504d6bb992b07b9dd68232', 'request_id': 'req-ec883ae1-e5b3-48e7-8069-b0180db59f50'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:01.752831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] The token cache is being invalidate because project 74f04a9e21504d6bb992b07b9dd68232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:01.753147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:01.753992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:01.759476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 720/1426] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:01 2022] DELETE /identity/v3/projects/74f04a9e21504d6bb992b07b9dd68232 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:01.760402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:01.761836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.842705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:01.851516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 707/1427] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:01.852363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:01.854267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:01.885307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883ae1-e5b3-48e7-8069-b0180db59f50 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:01.896889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:01.897665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:01.899287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:01.900779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:01.904005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.010524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10f7d1-7fce-4751-beb5-50658b31d0f1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:02.036568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:02.037238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.037738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.038104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] PATH_INFO: `/v3/users/c91884dcc0824d0ba11db5fd540aa2d4` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.039128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91884dcc0824d0ba11db5fd540aa2d4)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.041847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.085031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.086833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.124581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 721/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:02.126142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:02.141540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.160582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91884dcc0824d0ba11db5fd540aa2d4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.165125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91884dcc0824d0ba11db5fd540aa2d4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.171222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d8c2-21de-4d30-9ec5-6d2908fbb40c service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:02.185532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91884dcc0824d0ba11db5fd540aa2d4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.185721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:02.186394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.186788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.186958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.187844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:02.188151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.194725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.232851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91884dcc0824d0ba11db5fd540aa2d4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.237439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 722/1429] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:02.238160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:02.244588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.260508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fbc80592-7601-4ab5-bb82-52907e5cdc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91884dcc0824d0ba11db5fd540aa2d4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.279161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 708/1430] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:01 2022] DELETE /identity/v3/users/c91884dcc0824d0ba11db5fd540aa2d4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:02.282862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.282862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.282862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.289146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4457e-7e68-4dc7-9d3b-c52ab41c6781 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:02.352557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:02.353809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.448625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:02.449290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.449566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.450956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:02.453373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] PATH_INFO: `/v3/projects/462fc4468094423b80b29cdfd3d5046e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.456146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462fc4468094423b80b29cdfd3d5046e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.461183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.503754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 709/1431] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:02.504628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:02.511103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.571545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462fc4468094423b80b29cdfd3d5046e', 'request_id': 'req-73652d5c-9022-42d0-aa26-d3ae96e61906'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.583664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462fc4468094423b80b29cdfd3d5046e', 'request_id': 'req-73652d5c-9022-42d0-aa26-d3ae96e61906'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.593438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462fc4468094423b80b29cdfd3d5046e', 'request_id': 'req-73652d5c-9022-42d0-aa26-d3ae96e61906'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.625462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] The token cache is being invalidate because project 462fc4468094423b80b29cdfd3d5046e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:02.627805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.632605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:02.636198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 723/1432] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:02 2022] DELETE /identity/v3/projects/462fc4468094423b80b29cdfd3d5046e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:02.637620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb27d1d-ff8d-48a5-8e7e-61904d7d9bde None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:02.641035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:02.643632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.658699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:02.756102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:02.757947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.758259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.758517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.762796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:02.798661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.800190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f0099-756e-4a91-831a-0350aa6b4d49 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.818824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652d5c-9022-42d0-aa26-d3ae96e61906 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:02.830078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 710/1433] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:02.831780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87632-0729-4761-bd7f-02db5b1839cf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.834206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:02.834600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87632-0729-4761-bd7f-02db5b1839cf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.834844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.835123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.835338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87632-0729-4761-bd7f-02db5b1839cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.835437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.836029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:02.837987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42cf57-a5b0-4a4f-86d4-d797896c7b0c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:02.900231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 724/1434] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:02 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:02.904556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:02.904885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:02.905170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:02.954787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:02.956213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.093929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 725/1435] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:03.096285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.099327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.126268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e5e2-71ca-4b54-b410-5b0b70d90e7c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:03.147789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:03.149467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.149467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.149674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] PATH_INFO: `/v3/users/3b047975c2a14619a3c3653a9ee8cc45` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.151632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b047975c2a14619a3c3653a9ee8cc45)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:03.158650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:03.187529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96e87632-0729-4761-bd7f-02db5b1839cf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:03.198362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96e87632-0729-4761-bd7f-02db5b1839cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.225880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 711/1436] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:03.238038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315416-3355-4200-9998-71929a132d7a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.238346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315416-3355-4200-9998-71929a132d7a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.238631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315416-3355-4200-9998-71929a132d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.254424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b047975c2a14619a3c3653a9ee8cc45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:03.267941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b047975c2a14619a3c3653a9ee8cc45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:03.282010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-22315416-3355-4200-9998-71929a132d7a None None] MFA Rules not processed for user `80168c16c0ca44cb86c9691fda4aab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:03.283398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22315416-3355-4200-9998-71929a132d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.294357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b047975c2a14619a3c3653a9ee8cc45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:03.295011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b047975c2a14619a3c3653a9ee8cc45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:03.312174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b047975c2a14619a3c3653a9ee8cc45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:03.325837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 726/1437] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:03 2022] DELETE /identity/v3/users/3b047975c2a14619a3c3653a9ee8cc45 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:03.326717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.328601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.338460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:03.431162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 712/1438] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:03.432073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315416-3355-4200-9998-71929a132d7a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.436712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22315416-3355-4200-9998-71929a132d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.466319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315416-3355-4200-9998-71929a132d7a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:03.467923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220febad-0cb1-4fea-aaad-1ee1df782b59 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:03.483843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:03.484917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.485351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.485957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.486788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:03.492168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:03.493420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.493683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.494231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:03.494477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.495943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:03.496309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:03.498275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27f87e-c04b-46f9-9c01-f952a0ef37ab admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:03.527177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 713/1439] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:03.532882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.533266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.533670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.542355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 714/1440] 10.222.0.62 () {54 vars in 912 bytes} [Mon Oct 17 17:44:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:44:03.544335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.546437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.547463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 727/1441] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:03 2022] POST /identity/v3/users => generated 278 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:03.548548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.568946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa2528-6c24-4551-a751-8bd5a34263fb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:03.582480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:03.583192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.583567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.583846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.584747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:03.589180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ab72-9eea-48d8-9d12-21d12104f5a7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:03.643257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:03.661273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 728/1442] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:03 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:03.663313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.663313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.663313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.728495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:03.730844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:03.746360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b1b0a-3281-43c8-8774-0900b0179068 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:03.874298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 729/1443] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:44:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:03.875184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:03.905833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:03.906771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:03.908970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:03.909175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:03.914886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.009432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d05be7-fb87-4c04-9f71-ce2800b90ae8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.019402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.020056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.020323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.020641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.021973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.022945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.056956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 730/1444] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:04.057914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.081067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.082850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.083086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972561-ac44-4f99-a709-1ce0c28877e7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.096713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.097394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.099002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.099328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.100005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.107916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.111447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 715/1445] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:04.113380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.120272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.144878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c24cb9-53e3-4217-b341-d1d7594a0bed service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.150506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:04.152627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.153601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.163330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.164605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.182754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 731/1446] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:04 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:04.188609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.198724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.204003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.226467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd92b8-8bc8-489e-af4f-23dbe7c855d2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.227155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 716/1447] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:04.228197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.241000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.248696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.249394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.249960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.250457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.253025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.254931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.276729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 732/1448] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:04.279341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.290052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2c04-c37a-4d08-99b3-533ffdbc8f9a service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.294108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f83b4-3702-44c9-980b-e30aeb4b2274 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.302713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.303695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.304084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.304413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.305261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.307588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.307990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.308752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.324043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 733/1449] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:04.325096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.327159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.327523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] PATH_INFO: `/v3/projects/42fca2f434f24bd7a909e67cb889503b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.328114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.329314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fca2f434f24bd7a909e67cb889503b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.331235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.494528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0d26a-2214-472f-ab7e-7cfe4d96fb24 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.509302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fca2f434f24bd7a909e67cb889503b', 'request_id': 'req-865e9836-fe56-4225-ab19-fb6b9346d271'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:04.533504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fca2f434f24bd7a909e67cb889503b', 'request_id': 'req-865e9836-fe56-4225-ab19-fb6b9346d271'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:04.541512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fca2f434f24bd7a909e67cb889503b', 'request_id': 'req-865e9836-fe56-4225-ab19-fb6b9346d271'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:04.558559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:04.567645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] The token cache is being invalidate because project 42fca2f434f24bd7a909e67cb889503b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:04.568011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:04.571991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:04.575503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 717/1450] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:04 2022] DELETE /identity/v3/projects/42fca2f434f24bd7a909e67cb889503b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:04.578657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.582203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.628699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.629383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.629699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.630011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.632469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.647461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.649078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.662987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 734/1451] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:04.664005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.665370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.752222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c61ba5-e0dc-4abd-a133-1dc8aadc827c service placement] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.758227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.759007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.759384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.759896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.760844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.762800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8597748-c53d-4944-8ebf-c6418d75a28b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.778337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 735/1452] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:04.779907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.780440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.780850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.801566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:04.808942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:04.810348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.820186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 736/1453] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:04.821318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.837117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9836-fe56-4225-ab19-fb6b9346d271 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.839170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed31ce9-50f8-4ee9-a930-8792564a3890 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:04.846713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.848492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.848973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.849494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] PATH_INFO: `/v3/projects/31939aaa9bc4424fbc9ca8cbd55295b2/users/8bdc40724e124082b7a623e2e7b30264/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.863570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:04.864414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.864690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.864959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] PATH_INFO: `/v3/projects/c862edd7a66e482b8ebed15299ae6dd2/users/7dd600c468b147ceb7633de821d65963/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.876442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31939aaa9bc4424fbc9ca8cbd55295b2, user_id=8bdc40724e124082b7a623e2e7b30264, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.881773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3457aa-0cf6-4b2f-850f-d04d55f266d6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.905971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 737/1454] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:04 2022] PUT /identity/v3/projects/31939aaa9bc4424fbc9ca8cbd55295b2/users/8bdc40724e124082b7a623e2e7b30264/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:04.908081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff10d-5dd1-4d17-9235-974fc102e620 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:04.908508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff10d-5dd1-4d17-9235-974fc102e620 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:04.908803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff10d-5dd1-4d17-9235-974fc102e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:04.922864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c862edd7a66e482b8ebed15299ae6dd2, user_id=7dd600c468b147ceb7633de821d65963, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:04.925699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:04.948275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 718/1455] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:04 2022] PUT /identity/v3/projects/c862edd7a66e482b8ebed15299ae6dd2/users/7dd600c468b147ceb7633de821d65963/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:04.956797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:04.960314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:04.970738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cacff10d-5dd1-4d17-9235-974fc102e620 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:04.971975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cacff10d-5dd1-4d17-9235-974fc102e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.069842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 738/1456] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:05.071391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297500c-098e-4a05-a40b-66c3de1f46b6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.071747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297500c-098e-4a05-a40b-66c3de1f46b6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.072092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297500c-098e-4a05-a40b-66c3de1f46b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.139022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918aa5-e8b4-4d24-ae3d-022894e3d760 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:05.146043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c297500c-098e-4a05-a40b-66c3de1f46b6 None None] MFA Rules not processed for user `8bdc40724e124082b7a623e2e7b30264`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:05.151207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:05.151366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c297500c-098e-4a05-a40b-66c3de1f46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.151866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.152147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.152420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] PATH_INFO: `/v3/projects/e5e2bfab9cd048d8b67bafd8c89e8b1d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.153522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e2bfab9cd048d8b67bafd8c89e8b1d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:05.155662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:05.270949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e2bfab9cd048d8b67bafd8c89e8b1d', 'request_id': 'req-395099c5-1e46-406b-92c5-5b80306b77c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.288871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e2bfab9cd048d8b67bafd8c89e8b1d', 'request_id': 'req-395099c5-1e46-406b-92c5-5b80306b77c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.306217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e2bfab9cd048d8b67bafd8c89e8b1d', 'request_id': 'req-395099c5-1e46-406b-92c5-5b80306b77c5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.331610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] The token cache is being invalidate because project e5e2bfab9cd048d8b67bafd8c89e8b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:05.331910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.334629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.337677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 739/1458] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:05.337942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 719/1458] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:04 2022] DELETE /identity/v3/projects/e5e2bfab9cd048d8b67bafd8c89e8b1d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:05.339858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:05.340319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.340613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.344570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.344861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.366872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:05.442615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] MFA Rules not processed for user `7dd600c468b147ceb7633de821d65963`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:05.443979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.453223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395099c5-1e46-406b-92c5-5b80306b77c5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:05.462241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:05.465649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.465922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.466192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.469210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:05.469405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:05.472234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:05.516535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 720/1459] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:05.517960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:05.523229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.560365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3d40-794f-4c03-aea0-1b078a3ee618 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:05.568240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:05.568954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.569236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.569506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] PATH_INFO: `/v3/users/4c4716a9c854489a98e9e3cfbbeea52b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.586430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4716a9c854489a98e9e3cfbbeea52b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:05.595645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:05.610765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:05.647861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 740/1460] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:05.654720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:05.659263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.695190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effc6e9-8bfe-45ca-b31e-dc8e4eb2f2c2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:05.717866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:05.718762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.719231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.719580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.720466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:05.725404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373ca9a-e8ee-4a26-821e-a1b12fd7607e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:05.808936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4716a9c854489a98e9e3cfbbeea52b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.810157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4716a9c854489a98e9e3cfbbeea52b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.828905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4716a9c854489a98e9e3cfbbeea52b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.851271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 741/1461] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:05 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:05.855977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:05.856336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:05.856647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:05.868722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4716a9c854489a98e9e3cfbbeea52b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.893305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4716a9c854489a98e9e3cfbbeea52b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:05.909318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] MFA Rules not processed for user `bf24539086724dc4aa3d5c569a47e85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:05.910015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 721/1462] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:05 2022] DELETE /identity/v3/users/4c4716a9c854489a98e9e3cfbbeea52b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:05.910889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:05.911244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:05.913433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:06.007743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51a02-59d9-49b3-bb93-f374cc25e654 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.016199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.016873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.017150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.017424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.018164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.020756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.085527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 742/1463] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:06.087101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.092433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:06.099667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 722/1464] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:05 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:06.102272 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.109617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:06.132738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9cf73-2162-4bcd-aab3-0697418fdb71 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.133354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:06.407170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d5c3-a81b-4d1c-9f0e-bffb0593a28c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.414288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.414790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.415067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.416172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.417022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.419269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.463565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.465237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.465558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.465857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.467681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.473387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 723/1465] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:06 2022] POST /identity/v3/users => generated 300 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:06.474104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdd395-8f38-4bd4-b959-6e2636233e17 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.477296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.500136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add81a0c-f164-44ff-8f44-7ffa3fad1261 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.512847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.514576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.514988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.515267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.518321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.521191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.556597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 743/1466] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:06 2022] POST /identity/v3/projects => generated 357 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:06.557517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.559322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.561218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.598580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 724/1467] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:06 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:06.599727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.623410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] MFA Rules not processed for user `56dbff833b7f452a839852b02fb18672`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:06.626143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:06.631426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556fb8-33f4-444f-89de-b38d8acdc558 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.808263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 744/1468] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:06.812218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.814331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.814969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.815244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.815514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.816164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.818548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.838071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae224-67e2-45a6-95a9-35a50ec4210f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.843530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 725/1469] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:06.845334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.852611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.853091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.853711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.853993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.854645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.859041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.876425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279b55-12b3-4f54-9327-98c3d895817d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.892375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:06.894100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.897659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.897951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.901138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:06.901922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:06.903575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:06.932189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 745/1470] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:06 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:06.932189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.954988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 726/1471] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:06.956465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:06.974409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622636-d5e3-413e-b75e-d07a439a6a76 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.990565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102535b2-2ef3-4cca-9934-be89104a6871 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:06.993049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:06.998550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:06.998866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:06.999123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] PATH_INFO: `/v3/projects/560cce556e5845b99da284ed07d2bee5/users/06dc1fb176414832a737684932a132b9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.011504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.012279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.012696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.012983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.013666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.015297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.049347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 727/1472] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:07.050790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.054205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560cce556e5845b99da284ed07d2bee5, user_id=06dc1fb176414832a737684932a132b9, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.057286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.074720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e261-2111-4301-bc37-b871c48bd26c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.075733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 746/1473] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:06 2022] PUT /identity/v3/projects/560cce556e5845b99da284ed07d2bee5/users/06dc1fb176414832a737684932a132b9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:07.076955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.087469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:07.225422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:07.258225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.258866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.259149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.259469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.261823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.266266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.302002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 728/1474] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:07.303498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.327729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeb13d-36c8-47f8-ab5f-5d2fffe56264 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.346875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.351388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62ec60-7266-4bd6-b2a4-fec85e358609 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.355215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.359937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.360327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] PATH_INFO: `/v3/projects/26f71b71e79f421687dbd465633499e9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.361829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f71b71e79f421687dbd465633499e9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.366350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.374132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.374828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.375113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.375387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] PATH_INFO: `/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077/users/cdab27549b9048c4b96df18a398d3357/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.468765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa5ea97721b4621b9cd4b5e9cf3e077, user_id=cdab27549b9048c4b96df18a398d3357, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.482465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.487246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f71b71e79f421687dbd465633499e9', 'request_id': 'req-894b2a48-b6c8-4870-861e-10139e26c995'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:07.510397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f71b71e79f421687dbd465633499e9', 'request_id': 'req-894b2a48-b6c8-4870-861e-10139e26c995'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:07.521701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f71b71e79f421687dbd465633499e9', 'request_id': 'req-894b2a48-b6c8-4870-861e-10139e26c995'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:07.539665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 729/1475] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:07 2022] PUT /identity/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077/users/cdab27549b9048c4b96df18a398d3357/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:07.540599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.547309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] The token cache is being invalidate because project 26f71b71e79f421687dbd465633499e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:07.547703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:07.548743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:07.553006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 747/1476] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:07 2022] DELETE /identity/v3/projects/26f71b71e79f421687dbd465633499e9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:07.555455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.568909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:07.678589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ae7-1f0c-4713-a7a7-9d881bdd956c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.686290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.687307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.687721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.688671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.688800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.690917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.709683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 730/1477] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:07.709683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.716593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:07.754775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dbfb-fc9b-4de5-845d-b8c2a77c2c17 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.761312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.762085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.762369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.762642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.763479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.765108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f948dda-110b-4872-8f41-d319106b64bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.784089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 731/1478] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:07.785964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.786409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.787510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.816632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:07.819882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:07.829243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 732/1479] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:07.830234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.831639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:07.846159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43566c0e-8a58-4909-8dad-15fca6fc2832 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:07.854628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:07.855472 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:07.855810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:07.856149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] PATH_INFO: `/v3/projects/560cce556e5845b99da284ed07d2bee5/users/06dc1fb176414832a737684932a132b9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:07.858268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560cce556e5845b99da284ed07d2bee5, user_id=06dc1fb176414832a737684932a132b9, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:07.861359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:07.882626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 733/1480] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:07 2022] PUT /identity/v3/projects/560cce556e5845b99da284ed07d2bee5/users/06dc1fb176414832a737684932a132b9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:07.883617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:07.957239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:07.969357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2a48-b6c8-4870-861e-10139e26c995 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:08.028357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa52e1-8ded-4830-bace-9b87f20dda42 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:08.036601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:08.050021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.051504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.054233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] PATH_INFO: `/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077/users/cdab27549b9048c4b96df18a398d3357/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.063654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa5ea97721b4621b9cd4b5e9cf3e077, user_id=cdab27549b9048c4b96df18a398d3357, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:08.075307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b6fd2-d838-4229-870a-4073f5ae05e5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:08.095430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:08.096045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.096045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.096235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] PATH_INFO: `/v3/projects/8fa68d19d5ed48288bd464bb373097c9/users/883099774f9641e18c3d14714ebdd949/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.120184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa68d19d5ed48288bd464bb373097c9, user_id=883099774f9641e18c3d14714ebdd949, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:08.123133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a5267-e4c6-492b-b0c5-c411de04be1d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:08.145434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 734/1482] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:07 2022] PUT /identity/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077/users/cdab27549b9048c4b96df18a398d3357/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:08.147254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49b86-6990-454e-b557-335863f02acc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.150485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 748/1482] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:07 2022] PUT /identity/v3/projects/8fa68d19d5ed48288bd464bb373097c9/users/883099774f9641e18c3d14714ebdd949/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:08.150919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49b86-6990-454e-b557-335863f02acc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.152982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49b86-6990-454e-b557-335863f02acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.154646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322abe0-7ba0-4729-8042-df8b66999340 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.156670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322abe0-7ba0-4729-8042-df8b66999340 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.158769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322abe0-7ba0-4729-8042-df8b66999340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.222418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96c49b86-6990-454e-b557-335863f02acc None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:08.224146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96c49b86-6990-454e-b557-335863f02acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.229491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8322abe0-7ba0-4729-8042-df8b66999340 None None] MFA Rules not processed for user `06dc1fb176414832a737684932a132b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:08.230761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8322abe0-7ba0-4729-8042-df8b66999340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.261252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:08.358947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 735/1483] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:08.387167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.400456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.400762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.421650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 749/1484] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:08.421650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.421650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.421650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.508654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] MFA Rules not processed for user `883099774f9641e18c3d14714ebdd949`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:08.510439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.517269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] MFA Rules not processed for user `cdab27549b9048c4b96df18a398d3357`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:08.518185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.717054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 736/1485] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:08.721838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:08.731338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:08.757891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 750/1486] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:08.759209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:08.771064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.805177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd7ac-946b-4a08-80c7-6f2a38c54205 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:08.832507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:08.833299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.833811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.844811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:08.847152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:08.847471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:08.849599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:08.914906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 737/1487] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:08.915949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:08.923341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:08.981106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25dfd4-559a-4488-8e51-fa7f537c3c92 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:08.993093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:08.996464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:08.997000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:08.997565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.022083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.023694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.038182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 751/1488] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:09.039168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:09.071989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778ea3-2fa8-41d3-a969-7c851f22fd3c service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.074922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19082-d3fa-409b-9669-63c61df318dd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.089775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.092796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.096160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.096800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.104867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.104867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.106549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.107190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.107473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.107750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.140233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.142365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.157282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 738/1489] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:09.158433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:09.176393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 752/1490] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:09 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:09.177763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:09.186714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0367-6c00-458e-b685-acff22dc84d5 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.254782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:09.275957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378bcf-acfb-44fb-8194-0c2e92378ccb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.280079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.280808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.281249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.281474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.281786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.282060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.283737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.284301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] PATH_INFO: `/v3/users/8bdc40724e124082b7a623e2e7b30264` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.287191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdc40724e124082b7a623e2e7b30264)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.289701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.392036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdc40724e124082b7a623e2e7b30264'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.394597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdc40724e124082b7a623e2e7b30264'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.408670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdc40724e124082b7a623e2e7b30264'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.445674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.447201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037299b0-87ae-4d72-9a68-5a50ea4b23c3 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.462779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdc40724e124082b7a623e2e7b30264'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.488844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 753/1491] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:09.489729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdc40724e124082b7a623e2e7b30264'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.507475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 739/1492] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:09 2022] DELETE /identity/v3/users/8bdc40724e124082b7a623e2e7b30264 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:09.510853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.510853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.511049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:09.511487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.513606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:09.653812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:09.666565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:09.670526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:09.752843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af31c-2bd3-455d-8bf0-03ab87ff57d0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.770680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.771418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.772117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.772117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] PATH_INFO: `/v3/users/883099774f9641e18c3d14714ebdd949` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.773282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=883099774f9641e18c3d14714ebdd949)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.775255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.859416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 754/1493] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:09.880543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:09.883321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:09.924208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883099774f9641e18c3d14714ebdd949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.925709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883099774f9641e18c3d14714ebdd949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.942273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c0dd4-ff24-4677-9630-6e600f0a4785 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:09.952876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:09.953704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883099774f9641e18c3d14714ebdd949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:09.953811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:09.954204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:09.954673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:09.955633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:09.960766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c993d2-865b-446b-be48-9b1dd21a9d12 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:09.964607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:09.986073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883099774f9641e18c3d14714ebdd949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:10.008218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 755/1494] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:09 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:10.010682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.011475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.011898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.020256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883099774f9641e18c3d14714ebdd949'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:10.038527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 740/1495] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:09 2022] DELETE /identity/v3/users/883099774f9641e18c3d14714ebdd949 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:10.039417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:10.051706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.141758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:10.149254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.271131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8419b1-c42a-4743-b0ec-1f7cbc5f6b1f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:10.280006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:10.281029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.281208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.281400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.283911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.339361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 756/1496] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:10.341979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:10.343923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.366867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c795f-6116-4d66-90cc-cbf3da088f9a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:10.374602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:10.375322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.375652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.376012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.376714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:10.381263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b92e7-2a20-4b77-ba55-c47c140787ab admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:10.387419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:10.389807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:10.399943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 757/1497] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:10.401296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.401952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.402226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.406745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 741/1498] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:10.408231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:10.409858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.492523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:10.496021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.558263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 758/1499] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:10.564632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:10.572588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.823907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70d6e5-53d0-4e1a-b64a-cfbe0b64c0e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:10.838806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:10.846175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.846460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.846737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.891975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:10.896948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:10.931580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 759/1500] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:10.935873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:10.955038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c25d-7af8-4fe9-9abd-8ccb885d2a93 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:10.972948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65515d0c-2063-42b6-96b8-26c087bdd005 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:10.975866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:10.976540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.978335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.978620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:10.987782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:10.991215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:10.994940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:10.995219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:10.997843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.000315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.007117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f34e1-5f92-4379-8b55-431e0252540a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:11.022834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:11.048576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:11.056804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 760/1501] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:11.063123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.063319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.063558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.175009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:11.178290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:11.189403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 761/1502] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 17 17:44:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:11.190900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:11.194161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:11.213712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18e4b3-2c9b-4668-a01f-9cc047cf0cfb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:11.216815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.222602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:11.224197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.224721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:11.226660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.227902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.249543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 742/1503] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:44:11.250009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:11.252273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.256197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:11.280234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab52798-0411-4a91-96d2-17f6553077c3 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:11.285240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 762/1504] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:11.287342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:11.291907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:11.292608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.292882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.293155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] PATH_INFO: `/v3/projects/10323ceca9c04b4fb9aaebf4ea17864b/users/165f059b53a6470d8201c2019a57162d/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.314616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186149-767c-4d52-9ccc-68201ebdfcd8 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:11.336238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:11.340075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.341741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.346350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.373696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10323ceca9c04b4fb9aaebf4ea17864b, user_id=165f059b53a6470d8201c2019a57162d, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.385335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:11.386406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.393888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb8ae8-f119-44b0-b538-8ad4e003c222 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:11.428267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 763/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:11.432543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 743/1506] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:11 2022] PUT /identity/v3/projects/10323ceca9c04b4fb9aaebf4ea17864b/users/165f059b53a6470d8201c2019a57162d/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:11.444907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.445241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.445473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.519010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] MFA Rules not processed for user `165f059b53a6470d8201c2019a57162d`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:11.520332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:11.747971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 764/1507] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:11.752746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:11.963003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b67c5-6b34-4aa7-afd5-93ce82405401 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:11.970039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:11.970700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:11.971002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:11.971259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:11.971911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:11.974197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.036521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 744/1508] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:11 2022] POST /identity/v3/projects => generated 365 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:12.040906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:12.059518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607da9-cedc-4622-975f-ba27337d0e6b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:12.279404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:12.281563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.283442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.284326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.287113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:12.295104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.376695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 765/1509] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:12 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:12.379053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:12.397545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456784f-e823-41f8-9077-dec928445fc4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:12.403845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:12.404847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.405293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.405837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.406641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:12.408592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.427146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 745/1510] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:12.429415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:12.468238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ab0d-14f3-48fa-b93e-5e6519eedae0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:12.498026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:12.498816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.499100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.505283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] PATH_INFO: `/v3/projects/7cc405debc5d45e79b4b3519ed818ed6/users/690247e5c2b04980a9c72d8fa2b10d09/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.546063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc405debc5d45e79b4b3519ed818ed6, user_id=690247e5c2b04980a9c72d8fa2b10d09, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:12.549888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.571459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 766/1511] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:12 2022] PUT /identity/v3/projects/7cc405debc5d45e79b4b3519ed818ed6/users/690247e5c2b04980a9c72d8fa2b10d09/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:12.579244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:12.604081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6795da-7359-4981-840d-0dc856a63121 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:12.696973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:12.697938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.698374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.698794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.699591 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:12.701821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bff1a-5dc4-41e7-875f-90ed5b60727d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.719027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 746/1512] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:12.720161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:12.749885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1927d-ed89-4f91-a70b-4f85cbf38fe2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:12.769195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:12.770494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.771100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.771579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] PATH_INFO: `/v3/projects/7cc405debc5d45e79b4b3519ed818ed6/users/690247e5c2b04980a9c72d8fa2b10d09/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.779900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc405debc5d45e79b4b3519ed818ed6, user_id=690247e5c2b04980a9c72d8fa2b10d09, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:12.788664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:12.825633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 767/1513] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:12 2022] PUT /identity/v3/projects/7cc405debc5d45e79b4b3519ed818ed6/users/690247e5c2b04980a9c72d8fa2b10d09/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:12.837527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:12.837845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:12.838129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:12.847987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:12.886584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] MFA Rules not processed for user `690247e5c2b04980a9c72d8fa2b10d09`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:12.887816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:13.011223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 747/1514] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:13.018437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:13.020420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:13.050123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:13.149168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ae07-1307-4ca9-bfdb-30c64ecda9a1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:13.154190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:13.154912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:13.155188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:13.155457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:13.174586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:13.176985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:13.193403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 768/1515] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:13.451408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:13.464089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4b182-59cd-48f5-b14c-294d5f72ccad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:13.476345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:13.478596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:13.482547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:13.483325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:13.679283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:13.684798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:13.710503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 748/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:14.627387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:14.630686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:14.792809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b157ea-3cb0-4741-a907-f5037fc191c9 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:14.803393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:14.804075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:14.804671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:14.805248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] PATH_INFO: `/v3/projects/8fa68d19d5ed48288bd464bb373097c9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:14.808430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa68d19d5ed48288bd464bb373097c9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:14.810846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:14.887527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:14.890857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:14.932916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa68d19d5ed48288bd464bb373097c9', 'request_id': 'req-d226c67f-1285-40f7-bc48-bc24487f0b18'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:14.970092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa68d19d5ed48288bd464bb373097c9', 'request_id': 'req-d226c67f-1285-40f7-bc48-bc24487f0b18'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:14.980301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9a7dc-d73a-4dfb-82e0-ff0e17884315 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:14.994782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa68d19d5ed48288bd464bb373097c9', 'request_id': 'req-d226c67f-1285-40f7-bc48-bc24487f0b18'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.057696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] The token cache is being invalidate because project 8fa68d19d5ed48288bd464bb373097c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:15.057696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.063648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d226c67f-1285-40f7-bc48-bc24487f0b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.074261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 769/1517] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:14 2022] DELETE /identity/v3/projects/8fa68d19d5ed48288bd464bb373097c9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:15.081153 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b16f-4763-4fb1-9852-e6ab81d8a7a0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.081468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b16f-4763-4fb1-9852-e6ab81d8a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.081737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b16f-4763-4fb1-9852-e6ab81d8a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.171886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-acb4b16f-4763-4fb1-9852-e6ab81d8a7a0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:15.177011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-acb4b16f-4763-4fb1-9852-e6ab81d8a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:15.226521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:15.227622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.227959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.228288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] PATH_INFO: `/v3/projects/31939aaa9bc4424fbc9ca8cbd55295b2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.229640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31939aaa9bc4424fbc9ca8cbd55295b2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:15.245605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:15.284181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:15.320951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:15.347090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 770/1518] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:15.357693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.358003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.358285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.362595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31939aaa9bc4424fbc9ca8cbd55295b2', 'request_id': 'req-31d83d6d-0846-4e31-8225-3873f42503d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.383943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31939aaa9bc4424fbc9ca8cbd55295b2', 'request_id': 'req-31d83d6d-0846-4e31-8225-3873f42503d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.394398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31939aaa9bc4424fbc9ca8cbd55295b2', 'request_id': 'req-31d83d6d-0846-4e31-8225-3873f42503d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.427994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:15.429258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:15.429932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] The token cache is being invalidate because project 31939aaa9bc4424fbc9ca8cbd55295b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:15.436292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.449429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.458414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 749/1519] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:14 2022] DELETE /identity/v3/projects/31939aaa9bc4424fbc9ca8cbd55295b2 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:15.463543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:15.468319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:15.696968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 771/1520] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:15.706458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:15.723633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83d6d-0846-4e31-8225-3873f42503d1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:15.737964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7eaea-d3bd-4ec6-a7a2-cdb885ebf368 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:15.739684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:15.740455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.741780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.742187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] PATH_INFO: `/v3/users/06dc1fb176414832a737684932a132b9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.745651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=06dc1fb176414832a737684932a132b9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:15.754626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:15.755815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:15.756834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.757115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.757388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.758075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:15.758378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:15.759983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:15.819285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 772/1521] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:15.820893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:15.846407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd886-d39f-4175-83ec-99dba644b6b9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:15.860000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:15.860631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:15.860911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:15.861188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:15.866854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:15.880182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:15.887538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06dc1fb176414832a737684932a132b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.888716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06dc1fb176414832a737684932a132b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.911034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06dc1fb176414832a737684932a132b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.945143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06dc1fb176414832a737684932a132b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.963509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 773/1522] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:15 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:15.963680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06dc1fb176414832a737684932a132b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:15.966034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:15.969100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:15.994961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 750/1523] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:15 2022] DELETE /identity/v3/users/06dc1fb176414832a737684932a132b9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:16.160519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f465-9734-4e37-bfe9-c823811c9723 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:16.287566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:16.325764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:16.326448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.326727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.328805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.329624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:16.334133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:16.381718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 774/1524] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:15 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:16.387067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:16.418619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071493f-65ea-48a6-9b6b-13fe6d63c1df admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:16.434055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:16.434710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.435119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.438251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.439054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:16.445918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:16.465909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 751/1525] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:16.467227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:16.480209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548952e-ddbe-4929-9287-a27d70be2f54 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:16.499874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:16.501730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.502007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.504516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.505398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:16.510597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2fc62-deb5-4636-b32a-882700f4e338 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:16.555560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:16.557122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 775/1526] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:16.596126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be79c88-d9b3-4903-8984-e2b5aa3a6381 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:16.628034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:16.637388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.641189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.641477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] PATH_INFO: `/v3/projects/3ebec1cabb504551a5e771988f60daec/users/f7ea08283f60409ab6f2efac873cd8c0/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.690818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebec1cabb504551a5e771988f60daec, user_id=f7ea08283f60409ab6f2efac873cd8c0, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:16.698910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289f35-ed96-4978-9c48-6f845ecd8a5e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:16.713996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:16.725850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 752/1527] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:16 2022] PUT /identity/v3/projects/3ebec1cabb504551a5e771988f60daec/users/f7ea08283f60409ab6f2efac873cd8c0/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:16.739709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.740634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.740634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.838495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] MFA Rules not processed for user `f7ea08283f60409ab6f2efac873cd8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:16.843902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:16.889434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105df1-f483-44ba-832c-068c425a46bb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.890005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105df1-f483-44ba-832c-068c425a46bb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.890005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105df1-f483-44ba-832c-068c425a46bb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.891358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 753/1528] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:44:16.916694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:16.916978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:16.917254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:16.976546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:16.982680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:17.136610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 776/1529] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:17.145568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:17.147202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:17.294691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 754/1530] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:17.392672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcebf8-ba68-4907-ac19-9c51741bb125 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:17.398309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:17.399707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:17.399995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:17.400251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:17.415382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:17.417569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:17.451211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 777/1531] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:44:17.548699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:17.550768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:17.637953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa3bf7-dee5-4aa9-a8b7-43f79175f778 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:17.662168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:17.662823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:17.663105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:17.663381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:17.689906 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:17.693515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5afd2-986b-4d20-b39e-f7e63f1ccfdc service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:17.726432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 755/1532] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:19.351084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:19.354565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:19.540457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5a394-128f-4289-b44d-34e1aff3d2d5 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:19.566320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:19.566628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:19.566955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:19.567231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] PATH_INFO: `/v3/projects/560cce556e5845b99da284ed07d2bee5` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:19.568655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560cce556e5845b99da284ed07d2bee5)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:19.571775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:19.589782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:19.732481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560cce556e5845b99da284ed07d2bee5', 'request_id': 'req-7e66a460-b3fd-4ede-915e-89c02d8615c1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:19.742939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560cce556e5845b99da284ed07d2bee5', 'request_id': 'req-7e66a460-b3fd-4ede-915e-89c02d8615c1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:19.753530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560cce556e5845b99da284ed07d2bee5', 'request_id': 'req-7e66a460-b3fd-4ede-915e-89c02d8615c1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:19.771933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] The token cache is being invalidate because project 560cce556e5845b99da284ed07d2bee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:19.772229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:19.772980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e66a460-b3fd-4ede-915e-89c02d8615c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:19.774982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 778/1533] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:19 2022] DELETE /identity/v3/projects/560cce556e5845b99da284ed07d2bee5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:19.780104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:19.780628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:19.780628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:19.850536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:19.851809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:20.037036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 756/1534] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:20.044625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.044778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.045230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.116998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:20.118463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:20.172108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 779/1535] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:20.176300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.195198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aba53d-1826-4498-b3af-3c36b81c1fa2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.208375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.209033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.209315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.209608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.210285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:20.210592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:20.220878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:20.272243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 757/1536] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:20.276246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.291082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6223a3-97ab-48d3-8473-2c4b78d2bd47 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.305020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.305877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.306266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.306648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.307571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:20.312366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:20.477638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.479665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 780/1537] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:20 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:20.493641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87dbde-72c4-4635-b379-3c15d5b49880 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.660507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.663977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.664325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.665247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.666022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:20.668660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:20.696710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:20.764712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 758/1538] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:20 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:20.769153 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.784095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d976a6-6065-421b-8c15-5f421d55d323 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.800999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.803028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.804889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.805645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.806374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:20.810730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:20.842472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 781/1539] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:20.843550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.876304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05e22-4366-439b-b030-dcf374d65192 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.884084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.885100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.894464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.896348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:20.898851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:20.903072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd57e0-49e6-416e-871c-d6529c0a059e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:20.952124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 759/1540] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:20.956335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:20.969507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da9479-8045-4f34-88b6-1cd73f2fdc75 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:20.982369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:20.983063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:20.983343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:20.983618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] PATH_INFO: `/v3/projects/96c822c62e144ed29b2de618b4232758/users/da49eb96a8164ec8835245f2bbe8e1c8/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.028995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c822c62e144ed29b2de618b4232758, user_id=da49eb96a8164ec8835245f2bbe8e1c8, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:21.031732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:21.061137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 782/1541] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:20 2022] PUT /identity/v3/projects/96c822c62e144ed29b2de618b4232758/users/da49eb96a8164ec8835245f2bbe8e1c8/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:21.063382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:21.063382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:21.063601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.104931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] MFA Rules not processed for user `da49eb96a8164ec8835245f2bbe8e1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:21.127053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:21.254649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 760/1542] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:21.256944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:21.276555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:21.282306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:21.528344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea94e0-ce25-4a70-bb26-8b1048ac676c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:21.547658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:21.548492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:21.548779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:21.549050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.552539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:21.556017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:21.583962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0665d-26e1-4155-8dc3-0c2e79b77c55 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:21.597651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:21.600646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:21.601061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:21.602235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] PATH_INFO: `/v3/users/165f059b53a6470d8201c2019a57162d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.605118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165f059b53a6470d8201c2019a57162d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:21.610122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:21.614318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 783/1543] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:21 2022] POST /identity/v3/projects => generated 387 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:21.619519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:21.657264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:21.734082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165f059b53a6470d8201c2019a57162d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:21.736896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165f059b53a6470d8201c2019a57162d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:21.752473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165f059b53a6470d8201c2019a57162d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:21.771092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7e19-3f2d-42ca-8d28-ea08dd845bf1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:21.780398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165f059b53a6470d8201c2019a57162d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:21.783732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:21.784376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:21.786733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:21.787032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:21.788341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.788996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:21.793341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff5e2ad6-1d82-4ca7-a9c0-dfadf7f662c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165f059b53a6470d8201c2019a57162d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:21.793703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:21.824826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 761/1544] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:21 2022] DELETE /identity/v3/users/165f059b53a6470d8201c2019a57162d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:21.830534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:21.830821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:21.831111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:21.861326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 784/1545] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:21 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:21.866426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:21.869292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:21.890695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2bbde-eaba-4742-a2b3-0017cbef3929 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:21.920851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:21.922133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:22.048669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:22.049376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.049927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.050209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.052408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:22.055528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:22.085632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 785/1546] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:22.087240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:22.115681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42fa3-7eba-4d6e-8788-a6d3f84eed7d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:22.131477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:22.132105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.132380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.132650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.133297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:22.134932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e97bb-ac46-4756-a9b7-1a2829500c6b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:22.161795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 762/1547] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:22.170486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 786/1548] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:22.171094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:22.202599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89c407-f935-45eb-ae8b-f20226249512 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:22.216017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:22.219026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.220512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.221133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] PATH_INFO: `/v3/projects/3bb185c251694324b0f70abb00c6dd71/users/923585c1b05641aeb0833ff49ff029a7/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.243526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fd8c1-7378-488f-93e8-5be0da5d7be5 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.244115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fd8c1-7378-488f-93e8-5be0da5d7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.244389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fd8c1-7378-488f-93e8-5be0da5d7be5 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.246133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 787/1549] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:44:22.269824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb185c251694324b0f70abb00c6dd71, user_id=923585c1b05641aeb0833ff49ff029a7, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:22.279727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1791f-abaf-44ab-8dc2-8087a501c830 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:22.280973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.281120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.281395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.314215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 763/1550] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:22 2022] PUT /identity/v3/projects/3bb185c251694324b0f70abb00c6dd71/users/923585c1b05641aeb0833ff49ff029a7/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:22.323518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.325140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.325559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.334772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:22.336354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:22.402612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] MFA Rules not processed for user `923585c1b05641aeb0833ff49ff029a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:22.406183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:22.612909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 788/1551] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:22.613458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 764/1552] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:22.617641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:22.619743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:22.622537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:22.719307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:22.791984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301f7ab-0ad8-4c8e-8f88-2ad62dbc273d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:22.795662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80d8d-1547-48fa-9509-32ca14dfb69e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:22.796713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:22.798184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.798546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.799138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.803121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:22.804490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:22.805350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:22.806130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:22.806952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:22.809956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:22.815869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:22.821410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:22.823348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:22.844838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 789/1553] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:22.896305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 765/1554] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:22 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:22.897670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:22.914892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0bb7c-210f-41b9-993a-262bb14877d5 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.076680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.077444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.077853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.078233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.078986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.084914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.139897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 790/1555] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:22 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:23.143358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.180408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48507dfa-5a68-4f4a-bc69-a23cfeb6688d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.199664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.200319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.200601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.200876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.201536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.203187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.245360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 766/1556] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:23.249709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.282088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e503e4c-d1df-470f-aae7-ab6fe7a0cbb8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.298057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.298979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.300875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.301521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] PATH_INFO: `/v3/projects/2fff9808ec5a480a899c21dd3ab8813d/users/8b0b1f4fe2e447979b2ba8cf26652d3f/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.354104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fff9808ec5a480a899c21dd3ab8813d, user_id=8b0b1f4fe2e447979b2ba8cf26652d3f, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.359263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.385132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 791/1557] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:23 2022] PUT /identity/v3/projects/2fff9808ec5a480a899c21dd3ab8813d/users/8b0b1f4fe2e447979b2ba8cf26652d3f/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:23.389295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.400239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c363a2-6daf-4184-b5ed-e1b440bafe5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.482088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.482745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.483165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.483504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.484156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.486236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d361d53-36d4-462e-bff2-d7ae0fd06dc4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.501625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 767/1558] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:23.503806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.515920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c407a-a68a-45d0-a9f9-4191d57e180c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.521370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.522270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.522549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.522823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] PATH_INFO: `/v3/projects/2fff9808ec5a480a899c21dd3ab8813d/users/8b0b1f4fe2e447979b2ba8cf26652d3f/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.524864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fff9808ec5a480a899c21dd3ab8813d, user_id=8b0b1f4fe2e447979b2ba8cf26652d3f, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.527610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.541836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 792/1559] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:23 2022] PUT /identity/v3/projects/2fff9808ec5a480a899c21dd3ab8813d/users/8b0b1f4fe2e447979b2ba8cf26652d3f/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:23.550827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.551947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.553102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.617912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] MFA Rules not processed for user `8b0b1f4fe2e447979b2ba8cf26652d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:23.620514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:23.655209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.657995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:23.778172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 768/1560] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:23.779124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.781159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:23.834014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560ee0-757f-4be3-8760-90bf3506f8cd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.850494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.851464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.851749 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.852101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.862555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.864383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.876658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 793/1561] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:23.877787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:23.879514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:23.892477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:23.901485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:23.911579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48376-cd24-4f97-99d9-020c9a8b5817 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:23.916744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:23.917715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:23.918227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:23.918877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] PATH_INFO: `/v3/projects/10323ceca9c04b4fb9aaebf4ea17864b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:23.920506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10323ceca9c04b4fb9aaebf4ea17864b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:23.922717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:23.983429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470917-a51f-4042-b85c-d972602a6ae9 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:24.009529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10323ceca9c04b4fb9aaebf4ea17864b', 'request_id': 'req-27449c23-c554-4dda-8a9e-a3a791987980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.019612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10323ceca9c04b4fb9aaebf4ea17864b', 'request_id': 'req-27449c23-c554-4dda-8a9e-a3a791987980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.032895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10323ceca9c04b4fb9aaebf4ea17864b', 'request_id': 'req-27449c23-c554-4dda-8a9e-a3a791987980'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.047512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] The token cache is being invalidate because project 10323ceca9c04b4fb9aaebf4ea17864b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:24.047845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.048809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.055094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 769/1562] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:23 2022] DELETE /identity/v3/projects/10323ceca9c04b4fb9aaebf4ea17864b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:24.068637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:24.077941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:24.113855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:24.114658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:24.114935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:24.115204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:24.117110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:24.224087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449c23-c554-4dda-8a9e-a3a791987980 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:24.229560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:24.230255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:24.230532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:24.230809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] PATH_INFO: `/v3/users/690247e5c2b04980a9c72d8fa2b10d09` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:24.232628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690247e5c2b04980a9c72d8fa2b10d09)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:24.235090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:24.262217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:24.263963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:24.290646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 794/1563] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:24.316202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690247e5c2b04980a9c72d8fa2b10d09'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.317224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690247e5c2b04980a9c72d8fa2b10d09'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.326775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690247e5c2b04980a9c72d8fa2b10d09'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.344517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690247e5c2b04980a9c72d8fa2b10d09'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.374701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7ca92cee-4b65-4d65-b229-bdc2421fb7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690247e5c2b04980a9c72d8fa2b10d09'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:24.387648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 770/1564] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:24 2022] DELETE /identity/v3/users/690247e5c2b04980a9c72d8fa2b10d09 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:24.987547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.012948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fa0e-6872-43f0-a72c-8fd34f8251f5 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.100073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.100724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.101001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.101268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] PATH_INFO: `/v3/projects/7cc405debc5d45e79b4b3519ed818ed6` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.102546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc405debc5d45e79b4b3519ed818ed6)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.104531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.119322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:25.181189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc405debc5d45e79b4b3519ed818ed6', 'request_id': 'req-e6e2e499-23ee-44af-b94c-7de4956e41b4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:25.194384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc405debc5d45e79b4b3519ed818ed6', 'request_id': 'req-e6e2e499-23ee-44af-b94c-7de4956e41b4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:25.203218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc405debc5d45e79b4b3519ed818ed6', 'request_id': 'req-e6e2e499-23ee-44af-b94c-7de4956e41b4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:25.220274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] The token cache is being invalidate because project 7cc405debc5d45e79b4b3519ed818ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:25.220699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:25.221468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e6e2e499-23ee-44af-b94c-7de4956e41b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:25.224379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 795/1565] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:24 2022] DELETE /identity/v3/projects/7cc405debc5d45e79b4b3519ed818ed6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:25.230338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.230879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.230879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.242890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:25.259939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:25.261150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:25.341069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 771/1566] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:25.347484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.347777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.348087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.374932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:25.376338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:25.386896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 796/1567] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:25.391479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.403054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d64f23-5c95-4065-8f6c-242e3b67c84d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.407755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.408377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.408653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.408924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.409635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:25.409940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.411849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.424932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 772/1568] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:25.429392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.447181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706701-de92-4f6d-9392-27ccb8673736 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.460896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.461526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.461840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.462109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.462791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.464888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.465054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.469456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:25.498377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 797/1569] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:25 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:25.509458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.558124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59da98-7c29-46db-9272-441178433819 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.584598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65405d0e-9d95-41ef-be59-fded991c1703 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.589919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.590559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.591867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.591867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.591867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.593685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.626605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 798/1570] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:25 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:25.626818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.627288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.627569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.627841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.630170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:25.631699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.647034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f18c2-d7d6-47b0-aaeb-53060e01feaa admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.652027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.652703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.652985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.653407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.654108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.655883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.671300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 799/1571] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:25.672748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.699730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b63df-6422-420b-9090-020dba66fe66 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.715640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.716352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.716665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.716946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.717736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.719387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d1b9-72b4-48c0-b247-6e645bc109eb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.720408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.722322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.735201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 773/1572] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:25.746452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 800/1573] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:25.750443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:25.759035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:25.767505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f75a-d3a9-4686-add2-635017c9fe32 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:25.775629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:25.776339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.776594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.776861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] PATH_INFO: `/v3/projects/d157dca08c7e4931956d42581d908652/users/7639c0c594314bc781c68a2baedf3d29/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.796359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d157dca08c7e4931956d42581d908652, user_id=7639c0c594314bc781c68a2baedf3d29, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:25.799066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:25.818201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 774/1574] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:25 2022] PUT /identity/v3/projects/d157dca08c7e4931956d42581d908652/users/7639c0c594314bc781c68a2baedf3d29/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:25.828367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:25.828652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:25.828924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:25.864312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] MFA Rules not processed for user `7639c0c594314bc781c68a2baedf3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:25.865556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:25.908156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:26.010097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 801/1575] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:26.015075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.112572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c290-d346-45a8-a24c-45b1a02f1033 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.119759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.120514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.120901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.121269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.122006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.124228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.163311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 775/1576] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:26 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:26.170173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.185141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027ba3a-0760-48a2-95e3-119209a6ab20 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.308349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.309442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.309442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.309442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.310370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.312558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.340648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 802/1577] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:26 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:26.344279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.358829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890790ad-5235-4a66-a2d7-bca8d225d2d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.365034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.365903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.367863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.368046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.369035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.371839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.396895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 776/1578] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:26.398540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.410488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5c3a-f8e8-476b-847c-8bac46510efa admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.420955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.422333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.422613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.422891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] PATH_INFO: `/v3/projects/2e63159d0675434da1b497ba61186955/users/5e4ad53ae926408986f1f4a99b8ab73d/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.448003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e63159d0675434da1b497ba61186955, user_id=5e4ad53ae926408986f1f4a99b8ab73d, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.451836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.476734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 803/1579] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:26 2022] PUT /identity/v3/projects/2e63159d0675434da1b497ba61186955/users/5e4ad53ae926408986f1f4a99b8ab73d/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:26.484280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.506817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f759bb-a9de-45e4-b16b-89d5b3e47b61 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.589197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.590325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.590681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.590942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.591599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.593375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15587f6-e4e2-4fe1-9c4c-53157305d29d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.606358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 777/1580] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:26.610628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.624774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0b8a-3e4d-40c5-9063-fb3b94754183 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.630305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.631195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.631536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.631781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] PATH_INFO: `/v3/projects/2e63159d0675434da1b497ba61186955/users/5e4ad53ae926408986f1f4a99b8ab73d/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.633736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e63159d0675434da1b497ba61186955, user_id=5e4ad53ae926408986f1f4a99b8ab73d, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.636581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.655586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 804/1581] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:26 2022] PUT /identity/v3/projects/2e63159d0675434da1b497ba61186955/users/5e4ad53ae926408986f1f4a99b8ab73d/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:26.667494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.667778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.668049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.696920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] MFA Rules not processed for user `5e4ad53ae926408986f1f4a99b8ab73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:26.698167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:26.740312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:26.773065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 778/1582] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:26.784633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:26.786707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:26.850057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084cb9-6a19-4a35-b878-d0369caf8261 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:26.854932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:26.855562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:26.855841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:26.856115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:26.898638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:26.930142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:26.932425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2ad58-c1ee-4854-9953-0200be9a7293 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:26.942403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 805/1583] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:30.628519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:30.644403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3d79-1b57-40f2-ad4f-927b563c6a58 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:30.649666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:30.650680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:30.651496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:30.651496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:30.653944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:30.767803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:30.771255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87313972-acd1-4bd6-85ed-7705820eb3ed service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:30.783064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 779/1584] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:30.870632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:30.871135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:30.871575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:30.873509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 806/1585] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:44:30.909188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:30.909468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:30.909780 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:30.933290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:30.934802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:30.943471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:30.945904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.043425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 780/1586] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:31.044425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:31.045894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.061375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c57fd-d51f-42a7-a5e7-31e7d230098a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.067674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.069481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.069872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.070218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] PATH_INFO: `/v3/users/7dd600c468b147ceb7633de821d65963` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.071993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd600c468b147ceb7633de821d65963)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.074616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.082234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201359c3-dc21-4b31-83fb-259604aa893c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.098915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.100077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.100527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.100931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] PATH_INFO: `/v3/users/f7ea08283f60409ab6f2efac873cd8c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.103844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ea08283f60409ab6f2efac873cd8c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.107005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.153696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd600c468b147ceb7633de821d65963'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.164367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd600c468b147ceb7633de821d65963'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.184238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd600c468b147ceb7633de821d65963'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.185391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd600c468b147ceb7633de821d65963'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.199296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd600c468b147ceb7633de821d65963'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.228950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 807/1587] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:30 2022] DELETE /identity/v3/users/7dd600c468b147ceb7633de821d65963 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:31.230493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:31.234786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.238563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ea08283f60409ab6f2efac873cd8c0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.240142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ea08283f60409ab6f2efac873cd8c0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.257176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ea08283f60409ab6f2efac873cd8c0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.265953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:31.296689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ea08283f60409ab6f2efac873cd8c0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.307379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-38d40736-c0fd-42da-9ad6-054cba955d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ea08283f60409ab6f2efac873cd8c0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:31.318783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 781/1588] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:31 2022] DELETE /identity/v3/users/f7ea08283f60409ab6f2efac873cd8c0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:31.321357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b6f-002e-40a0-9da6-0654aeac5679 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.322050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b6f-002e-40a0-9da6-0654aeac5679 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.323464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b6f-002e-40a0-9da6-0654aeac5679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.355730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dff74b6f-002e-40a0-9da6-0654aeac5679 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:31.358503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dff74b6f-002e-40a0-9da6-0654aeac5679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.406815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:31.445863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52801c85-7beb-4541-ae27-829994d2d8b5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.487052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 782/1589] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:31.488799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.489100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.489376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.510680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:31.511888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.521602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 783/1590] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:31.522480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:31.523785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.548302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.548941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.549219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.549490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.551356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.563946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.565762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.578820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 808/1591] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:31.579595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:31.582596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.604543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475406-609c-4fac-91a8-cf57a77ff157 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.611121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.614567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.614921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.615262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.628641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.630405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.641120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 784/1592] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:31.665159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6716-3917-4db1-aa81-69788c4b900e service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.665159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.665159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.665159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.665640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.697887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.701846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.717408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 809/1593] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:31.753693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:31.756048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.833462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54babde-4c4b-4316-bfe7-e7a71f63d4a6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:31.837685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:31.838640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:31.838986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:31.839360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:31.841351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:31.878250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:31.935773 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:31.937180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:31.970469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 785/1594] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:32.158304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.161114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.209773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac25bac-0ecf-4058-8341-8f42d068c3ca service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:32.235489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:32.239013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.239793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.240441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] PATH_INFO: `/v3/projects/c862edd7a66e482b8ebed15299ae6dd2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.242019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c862edd7a66e482b8ebed15299ae6dd2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:32.245155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:32.259869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.261307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.282323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59cdc6-08fd-4986-a681-928ed17a8c4a service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:32.298377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:32.299822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.300141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.300623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] PATH_INFO: `/v3/projects/3ebec1cabb504551a5e771988f60daec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.306065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebec1cabb504551a5e771988f60daec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:32.308978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:32.341996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c862edd7a66e482b8ebed15299ae6dd2', 'request_id': 'req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.371381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c862edd7a66e482b8ebed15299ae6dd2', 'request_id': 'req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.387707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c862edd7a66e482b8ebed15299ae6dd2', 'request_id': 'req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.404737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] The token cache is being invalidate because project c862edd7a66e482b8ebed15299ae6dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:32.405359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.406125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.410780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 810/1595] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:32 2022] DELETE /identity/v3/projects/c862edd7a66e482b8ebed15299ae6dd2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:32.412068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.416268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.428560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:32.433610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebec1cabb504551a5e771988f60daec', 'request_id': 'req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.452515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebec1cabb504551a5e771988f60daec', 'request_id': 'req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.463065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebec1cabb504551a5e771988f60daec', 'request_id': 'req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.477294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] The token cache is being invalidate because project 3ebec1cabb504551a5e771988f60daec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:32.478606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.479403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1bdc73bb-bcde-47b3-9196-7b958af9e0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.481615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 786/1596] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:32 2022] DELETE /identity/v3/projects/3ebec1cabb504551a5e771988f60daec => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:32.501888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6ec8-0a67-45f3-b0cc-f9f606e42896 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.504938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6ec8-0a67-45f3-b0cc-f9f606e42896 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.505789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6ec8-0a67-45f3-b0cc-f9f606e42896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.557654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c54c6ec8-0a67-45f3-b0cc-f9f606e42896 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:32.563180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c54c6ec8-0a67-45f3-b0cc-f9f606e42896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.605652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefe50-57e6-4ad4-8fce-ccaf2044af21 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:32.692300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 787/1597] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:32.701525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.702290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.702290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.704987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:32.707244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.707599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.707982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] PATH_INFO: `/v3/users/cdab27549b9048c4b96df18a398d3357` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.709274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdab27549b9048c4b96df18a398d3357)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:32.711810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:32.729961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:32.732050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.743440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 788/1598] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:32.747974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.760250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b440-fd79-464f-999d-c23efcdec033 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:32.767598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:32.768319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.768737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.769144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.770292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:32.770650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:32.772842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:32.791576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdab27549b9048c4b96df18a398d3357'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.805419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdab27549b9048c4b96df18a398d3357'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.809662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 789/1599] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:32.813498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.820975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdab27549b9048c4b96df18a398d3357'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.822424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdab27549b9048c4b96df18a398d3357'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.825685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8898c0-aa0e-41a0-a8c1-13ebb97e8b05 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:32.830991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:32.831822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:32.831996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:32.832209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:32.833359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:32.834426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdab27549b9048c4b96df18a398d3357'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:32.835259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:32.842778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 811/1600] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:32 2022] DELETE /identity/v3/users/cdab27549b9048c4b96df18a398d3357 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:32.871684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 790/1601] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:32 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:32.878404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:32.880253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:32.916943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:32.965763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bc9f2-187a-4772-9f08-921ceea9afd8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.035911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.036575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.036867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.037318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.038046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.041094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.072467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 812/1602] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:32 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:33.073750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.081508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:33.090004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36546b28-b71d-4e2a-9d51-9ce5c2066da9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.097565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.098981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.099868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.100496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.101886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.104181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.125019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 791/1603] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:33.130566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.147418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c528c2-079f-4a3d-abf8-a43214b2529e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.159900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.160779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.161610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.161610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.162289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.164058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.180736 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 813/1604] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:33.185487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.194712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.210772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.219948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06a28-77a3-4723-a7ee-deac1721292c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.227041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.228112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.228686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.230166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] PATH_INFO: `/v3/projects/2bd7cfeb233d4f9d870f6cfbc4107edf/users/8eb931a91ec64baa8e6a35f2295eb005/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.230638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89e5f-74c3-4b8a-a093-62a9bc9a2c75 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.236919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.237974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.238085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.238403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] PATH_INFO: `/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.239645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa5ea97721b4621b9cd4b5e9cf3e077)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.241863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.255301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd7cfeb233d4f9d870f6cfbc4107edf, user_id=8eb931a91ec64baa8e6a35f2295eb005, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.259794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4d43f-099e-45ed-bf7b-ffef3eb82782 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.293384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 792/1605] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:33 2022] PUT /identity/v3/projects/2bd7cfeb233d4f9d870f6cfbc4107edf/users/8eb931a91ec64baa8e6a35f2295eb005/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:33.304710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.304710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.304929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.308601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa5ea97721b4621b9cd4b5e9cf3e077', 'request_id': 'req-458c78ca-2152-4387-92bf-d84076be5ef3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:33.319696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa5ea97721b4621b9cd4b5e9cf3e077', 'request_id': 'req-458c78ca-2152-4387-92bf-d84076be5ef3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:33.327917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa5ea97721b4621b9cd4b5e9cf3e077', 'request_id': 'req-458c78ca-2152-4387-92bf-d84076be5ef3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:33.343779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] The token cache is being invalidate because project 7fa5ea97721b4621b9cd4b5e9cf3e077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:33.344271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:33.345100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-458c78ca-2152-4387-92bf-d84076be5ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:33.350524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 814/1606] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:33 2022] DELETE /identity/v3/projects/7fa5ea97721b4621b9cd4b5e9cf3e077 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:33.351684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] MFA Rules not processed for user `8eb931a91ec64baa8e6a35f2295eb005`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:33.354136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726130-8cd3-426b-b96e-904216b6058b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.354136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726130-8cd3-426b-b96e-904216b6058b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.354403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726130-8cd3-426b-b96e-904216b6058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.357333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.396117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-45726130-8cd3-426b-b96e-904216b6058b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:33.397437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45726130-8cd3-426b-b96e-904216b6058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.483075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:33.507635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 793/1607] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:33.527706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.530321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.549235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 815/1608] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:33.551899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.552348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.552584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.574643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:33.576497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.586921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 816/1609] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:33.591181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.606028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa8abb-b292-4023-ab18-994e8c21e3db None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.612008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.612275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.613218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.613502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.614313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:33.614644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.616234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.631888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 817/1610] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:33.636477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.653626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb03-ef32-4b04-bf86-a34584ccaf30 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.659254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128436ee-9760-48b1-9c5d-7437a49723b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.661355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.662489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.663395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.663838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.664716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.665199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.665365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.665680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.665965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.669676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.676032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.677762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.688830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 794/1611] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:33.758427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 818/1612] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:33 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:33.759827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.778692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaa5f3-05a0-4aee-a381-37f63f8b841a service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:33.882645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:33.884540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:33.919819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:33.920493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:33.920815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:33.921071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:33.923919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:33.926036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:33.937757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:33.976487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 795/1613] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:33 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:33.978768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.016462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f0bf-f0f3-492e-91e1-83c43e0616db admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.016554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12acb3c-e7df-43de-b1c9-3a8a0b3636c2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.024134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.025633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.025936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.026463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] PATH_INFO: `/v3/users/da49eb96a8164ec8835245f2bbe8e1c8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.028036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da49eb96a8164ec8835245f2bbe8e1c8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.031935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.032475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.033866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.034158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.035545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.037251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.046813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.083931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 796/1614] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:34.086972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.121835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eeecf-88b6-43eb-b174-bb72d6a014ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.140175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.143200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.143940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.144050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.145839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.149669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da49eb96a8164ec8835245f2bbe8e1c8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:34.149898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.163636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da49eb96a8164ec8835245f2bbe8e1c8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:34.190078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 797/1615] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:34.191478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.197059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da49eb96a8164ec8835245f2bbe8e1c8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:34.198522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da49eb96a8164ec8835245f2bbe8e1c8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:34.207616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4a78-150c-4c41-894b-fc040a172f4d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.215890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.217018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.217202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.217552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] PATH_INFO: `/v3/projects/aefa84fb29414f3ba95cfcc050384abf/users/65a7c1924d34433b8fa1fb66ad5fc328/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.225851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2a6b7b05-8e7c-4305-81fd-d97ceca10081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da49eb96a8164ec8835245f2bbe8e1c8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:34.246365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 819/1616] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:33 2022] DELETE /identity/v3/users/da49eb96a8164ec8835245f2bbe8e1c8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:34.248181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.248464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.248748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.256638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefa84fb29414f3ba95cfcc050384abf, user_id=65a7c1924d34433b8fa1fb66ad5fc328, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.265539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fa50-fffc-4365-8e79-fe571009348d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.293509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 798/1617] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:34 2022] PUT /identity/v3/projects/aefa84fb29414f3ba95cfcc050384abf/users/65a7c1924d34433b8fa1fb66ad5fc328/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:34.293760 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:34.294972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:34.307524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.307796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.308163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.323416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:34.379438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] MFA Rules not processed for user `65a7c1924d34433b8fa1fb66ad5fc328`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:34.380882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:34.401202 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 820/1618] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:34.411190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.412540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:34.461415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 799/1619] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:34.467298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.468753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:34.472301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d5607-064a-4e3d-91e3-303dd2a74417 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.475905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.477166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.477447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.477835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.483797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d22c0-bce0-4e8f-ae5b-0e4048a09898 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.487600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.489159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.491352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.492170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.492625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.493245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.495026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.498222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.499366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 821/1620] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:44:34.543421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 800/1621] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:34 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:34.544652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.555190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d1593-7be5-420d-9c26-40359938c1fc service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.622325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.623712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.624053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.624325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.625156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.626909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.653433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 822/1622] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:34 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:34.657764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.668638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407443e-e7df-48c8-9656-ab6b4486b90f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.696078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.696726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.697007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.697276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.697971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.699678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.713305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 801/1623] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:34.717865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.729561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcafe9-04b7-4460-b28f-4fdc0cd0625d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.735496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.736198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.736476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.736748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] PATH_INFO: `/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4/users/bf6e431b68c144d0866024e098908bab/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.757713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac6642d855e43ccba7b4f7c9367f6c4, user_id=bf6e431b68c144d0866024e098908bab, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.761915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.783637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 823/1624] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:34 2022] PUT /identity/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4/users/bf6e431b68c144d0866024e098908bab/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:34.787639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.806201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09b1c-8fa9-4d06-8903-e97116f383f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.885224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.886237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.886721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.887173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.888168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.891224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b223aff-fd84-424a-9a7e-c407ac95e6d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.894064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:34.905751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 802/1625] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:34.909875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:34.921029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bf79-bdb5-4750-b81a-a6cd56f0e853 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:34.926632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:34.927307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.927581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.927848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] PATH_INFO: `/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4/users/bf6e431b68c144d0866024e098908bab/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.929808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac6642d855e43ccba7b4f7c9367f6c4, user_id=bf6e431b68c144d0866024e098908bab, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:34.933059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:34.953631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 824/1626] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:34 2022] PUT /identity/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4/users/bf6e431b68c144d0866024e098908bab/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:34.964353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:34.964716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:34.964997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:34.994835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] MFA Rules not processed for user `bf6e431b68c144d0866024e098908bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:34.996048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:35.076276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 803/1627] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:35.089430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:35.089430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:35.090723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:35.092632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:35.105617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:35.183244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f3d62-0529-4588-8c65-d354c8cdb9da admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:35.191886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:35.192572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:35.195865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:35.195865 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:35.206471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:35.208144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:35.219208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32969d-76fa-4e8b-ba52-746526c82363 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:35.224573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:35.225300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:35.225596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:35.225877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] PATH_INFO: `/v3/projects/96c822c62e144ed29b2de618b4232758` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:35.227078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c822c62e144ed29b2de618b4232758)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:35.229361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:35.235268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 825/1628] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:35.307151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c822c62e144ed29b2de618b4232758', 'request_id': 'req-75ae4888-8191-4afa-acc8-bb1aefcc679f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.321547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c822c62e144ed29b2de618b4232758', 'request_id': 'req-75ae4888-8191-4afa-acc8-bb1aefcc679f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.338044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c822c62e144ed29b2de618b4232758', 'request_id': 'req-75ae4888-8191-4afa-acc8-bb1aefcc679f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.364546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] The token cache is being invalidate because project 96c822c62e144ed29b2de618b4232758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:35.364888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.365629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75ae4888-8191-4afa-acc8-bb1aefcc679f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.367549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 804/1629] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:35 2022] DELETE /identity/v3/projects/96c822c62e144ed29b2de618b4232758 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:35.371754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:35.395776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c1bd-ebef-4f81-a88c-6f1d21d7cc73 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:35.514660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:35.514963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:35.517103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:35.517103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] PATH_INFO: `/v3/users/923585c1b05641aeb0833ff49ff029a7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:35.518792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=923585c1b05641aeb0833ff49ff029a7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:35.521185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:35.531892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:35.532923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:35.533367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:35.564709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] MFA Rules not processed for user `8eb931a91ec64baa8e6a35f2295eb005`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:35.570623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:35.591957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:35.632677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923585c1b05641aeb0833ff49ff029a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.645561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923585c1b05641aeb0833ff49ff029a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.672654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923585c1b05641aeb0833ff49ff029a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.673396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923585c1b05641aeb0833ff49ff029a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.681533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923585c1b05641aeb0833ff49ff029a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:35.684107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 805/1630] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:35.692994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 826/1631] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:35 2022] DELETE /identity/v3/users/923585c1b05641aeb0833ff49ff029a7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:36.035638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:36.037657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:36.060841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493118c7-7f14-4c59-9d0e-95f1d627c382 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:36.137952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:36.138603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:36.138884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:36.139324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] PATH_INFO: `/v3/projects/3bb185c251694324b0f70abb00c6dd71` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:36.140778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb185c251694324b0f70abb00c6dd71)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:36.142755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:36.200720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb185c251694324b0f70abb00c6dd71', 'request_id': 'req-443ffbd7-8c8e-4e36-ad89-3c36e6330759'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.211336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb185c251694324b0f70abb00c6dd71', 'request_id': 'req-443ffbd7-8c8e-4e36-ad89-3c36e6330759'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.218911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb185c251694324b0f70abb00c6dd71', 'request_id': 'req-443ffbd7-8c8e-4e36-ad89-3c36e6330759'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.233486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] The token cache is being invalidate because project 3bb185c251694324b0f70abb00c6dd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:36.233868 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.234603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.236421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 806/1632] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:36 2022] DELETE /identity/v3/projects/3bb185c251694324b0f70abb00c6dd71 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:36.241362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:36.244526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:36.287099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683161f-91a3-46cb-bcff-c00c63154b7d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:36.356458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:36.423604 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:36.424264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:36.424544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:36.424862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] PATH_INFO: `/v3/users/8b0b1f4fe2e447979b2ba8cf26652d3f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:36.429338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0b1f4fe2e447979b2ba8cf26652d3f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:36.431429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:36.526970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0b1f4fe2e447979b2ba8cf26652d3f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.556366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0b1f4fe2e447979b2ba8cf26652d3f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.592188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0b1f4fe2e447979b2ba8cf26652d3f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.593016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0b1f4fe2e447979b2ba8cf26652d3f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.606055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5d79f817-b2e5-4891-b668-37bcc39541ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0b1f4fe2e447979b2ba8cf26652d3f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:36.621139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 827/1633] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:36 2022] DELETE /identity/v3/users/8b0b1f4fe2e447979b2ba8cf26652d3f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:37.123010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.124503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.153752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ffbd7-8c8e-4e36-ad89-3c36e6330759 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.210664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:37.224592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.225293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.225572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.225877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] PATH_INFO: `/v3/projects/2fff9808ec5a480a899c21dd3ab8813d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.227016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fff9808ec5a480a899c21dd3ab8813d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.228940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.290362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fff9808ec5a480a899c21dd3ab8813d', 'request_id': 'req-0cb58ed4-a0cf-4178-9494-45548a251cea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.300538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fff9808ec5a480a899c21dd3ab8813d', 'request_id': 'req-0cb58ed4-a0cf-4178-9494-45548a251cea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.308649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fff9808ec5a480a899c21dd3ab8813d', 'request_id': 'req-0cb58ed4-a0cf-4178-9494-45548a251cea'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.323790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] The token cache is being invalidate because project 2fff9808ec5a480a899c21dd3ab8813d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:37.324089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.324751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0cb58ed4-a0cf-4178-9494-45548a251cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.326712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 807/1634] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:37 2022] DELETE /identity/v3/projects/2fff9808ec5a480a899c21dd3ab8813d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:37.333429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.333962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.334053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.356338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:37.356338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.425056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 828/1635] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:37.434548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.434939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.435285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.468434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:37.469888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.485448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 808/1636] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:37.486426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.497837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a2d2-8fd9-4098-aeea-fee860e46a02 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.506726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.507347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.507626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.507904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.508556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:37.508894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.510589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.514580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.516058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.523631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 829/1637] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:37.527441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.529345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95f166-bd44-4fcc-9ef5-b40162e346a4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.534566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.535270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.535545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.535818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] PATH_INFO: `/v3/users/65a7c1924d34433b8fa1fb66ad5fc328` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.537054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a7c1924d34433b8fa1fb66ad5fc328)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.539069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.541181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86895-76b4-4c19-b3c1-13d23fe8d20b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.546687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.547341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.547698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.547971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.548608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.550907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.587911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 830/1638] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:37.589210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.598494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a7c1924d34433b8fa1fb66ad5fc328'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.599479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a7c1924d34433b8fa1fb66ad5fc328'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.608561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a7c1924d34433b8fa1fb66ad5fc328'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.614295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:37.624613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a7c1924d34433b8fa1fb66ad5fc328'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.634065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f19fc6b5-b8bb-4852-a14a-0d03ad956a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a7c1924d34433b8fa1fb66ad5fc328'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:37.641178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 809/1639] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:37 2022] DELETE /identity/v3/users/65a7c1924d34433b8fa1fb66ad5fc328 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:37.646106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.646398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.646674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.665020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300a0c-379b-42ae-9b0a-e431c527887d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.667369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:37.668629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.715360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:37.737136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.737912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.738324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.738665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.739309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.740381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 810/1640] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:37.742787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.751639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.753125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.771032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 831/1641] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:37.772208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.773984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.788518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d9f55-1a88-4686-afe0-0361882d95c9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.794357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.795026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.795390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.795611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.796190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.797885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.810044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 832/1642] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:37.814318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.817326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339257b-0724-4332-be4c-501ddf0e3a0e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.821194 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.821834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.822112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.822509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.833627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91762581-a29a-4e20-9275-af0ad2cfe0b9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.836316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.837859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.846362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.847015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.847305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.847629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.848307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.849944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2a06-05f5-4f39-8e37-fe4589af7e3a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.850490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 811/1643] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:44:37.878920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 833/1644] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:37.882969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:37.893157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62130b-2442-4a70-bcc4-25efa6cbc83c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:37.898717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:37.899437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.899742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.900098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] PATH_INFO: `/v3/projects/05d0b036cf2f4f30ad9ed0d1c1328064/users/9ecc0961a88f409fbce226f9143da7e6/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.918432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d0b036cf2f4f30ad9ed0d1c1328064, user_id=9ecc0961a88f409fbce226f9143da7e6, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:37.921390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:37.937491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 812/1645] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:37 2022] PUT /identity/v3/projects/05d0b036cf2f4f30ad9ed0d1c1328064/users/9ecc0961a88f409fbce226f9143da7e6/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:37.949094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:37.949383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:37.951085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:37.994289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] MFA Rules not processed for user `9ecc0961a88f409fbce226f9143da7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:37.996232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:37.998837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.001514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.100988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 834/1646] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:38.104829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.137807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae58-7fa0-4bb3-ab45-43474e45ba38 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.144715 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:38.146282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.146856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.147623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.147894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] PATH_INFO: `/v3/users/7639c0c594314bc781c68a2baedf3d29` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.149398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7639c0c594314bc781c68a2baedf3d29)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.151399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.195641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89e255-1d21-4d88-b9f9-cee6a508d3e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.200954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.201706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.201987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.202301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.202987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.204909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.213324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7639c0c594314bc781c68a2baedf3d29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.214371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7639c0c594314bc781c68a2baedf3d29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.226831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7639c0c594314bc781c68a2baedf3d29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.239790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 835/1647] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:38 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:38.240917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.243815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.245242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:38.247770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7639c0c594314bc781c68a2baedf3d29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.259258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7639c0c594314bc781c68a2baedf3d29'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.266803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 813/1648] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:37 2022] DELETE /identity/v3/users/7639c0c594314bc781c68a2baedf3d29 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:38.268560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.270299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.316713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f25a-dc18-4b15-b218-6d1390fa7aa0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.345535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6d90-3e55-426d-8d39-e67e8ccf9145 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.352670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.353914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.353914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.353914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.354993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.356459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e85d6-ef82-44ce-8783-13c7325ff45a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.379721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.380712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.380819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 814/1649] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:38 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:38.380899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.380899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] PATH_INFO: `/v3/projects/aefa84fb29414f3ba95cfcc050384abf` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.382259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefa84fb29414f3ba95cfcc050384abf)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.384142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.386918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.387194 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.387462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.407260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:38.408474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.417555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 815/1650] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:38.418204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.429304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09606d-66cf-4a7e-88f1-776a9006cb18 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.435299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.436994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.437426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.437902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.438759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.440385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.450799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefa84fb29414f3ba95cfcc050384abf', 'request_id': 'req-44e61558-a320-478f-bbde-7c494c38df44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.456533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 816/1651] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:38.456533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.456533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.463953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefa84fb29414f3ba95cfcc050384abf', 'request_id': 'req-44e61558-a320-478f-bbde-7c494c38df44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.465942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:38.472813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefa84fb29414f3ba95cfcc050384abf', 'request_id': 'req-44e61558-a320-478f-bbde-7c494c38df44'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.487056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] The token cache is being invalidate because project aefa84fb29414f3ba95cfcc050384abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:38.487417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.488289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.490515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 836/1652] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:38 2022] DELETE /identity/v3/projects/aefa84fb29414f3ba95cfcc050384abf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:38.491288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.492862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.522600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d153-7182-4c96-a7fa-f3965c4dcf89 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.575874 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.576637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.576976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.577319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.577419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e61558-a320-478f-bbde-7c494c38df44 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.579303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.582160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.582838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.583124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.583394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] PATH_INFO: `/v3/projects/7e4eb056eda345b7ab7be4955cca4c81/users/2f18c60bc4a944b5b602e9978caaa037/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.592723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.594616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.600055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eb056eda345b7ab7be4955cca4c81, user_id=2f18c60bc4a944b5b602e9978caaa037, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.603001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.609786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 817/1653] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:38.611561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.612970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.624472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 837/1654] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:38 2022] PUT /identity/v3/projects/7e4eb056eda345b7ab7be4955cca4c81/users/2f18c60bc4a944b5b602e9978caaa037/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:38.628380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.629913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f70f9-1f55-4c1b-ab8b-88ece57429bb service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.640521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:38.706148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.706927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.707542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.708679 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] PATH_INFO: `/v3/users/bf6e431b68c144d0866024e098908bab` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.710273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6e431b68c144d0866024e098908bab)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.710528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac19bd-e545-49ba-97fa-644ace6e0b57 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.712742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.716676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.717521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.717834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.718102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.718748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.720554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.731848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 838/1655] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:38.735776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.748201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4350f-938a-4803-92e5-6b5c32b5bf09 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:38.754998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:38.756294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.756294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.756590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] PATH_INFO: `/v3/projects/7e4eb056eda345b7ab7be4955cca4c81/users/2f18c60bc4a944b5b602e9978caaa037/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.758691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eb056eda345b7ab7be4955cca4c81, user_id=2f18c60bc4a944b5b602e9978caaa037, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:38.761468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33180e-7434-4910-9d7c-47c03fd6b178 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:38.772767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 839/1656] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:38 2022] PUT /identity/v3/projects/7e4eb056eda345b7ab7be4955cca4c81/users/2f18c60bc4a944b5b602e9978caaa037/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:38.773067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6e431b68c144d0866024e098908bab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.773838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6e431b68c144d0866024e098908bab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.785161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6e431b68c144d0866024e098908bab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.787068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:38.787513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:38.787983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:38.803493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6e431b68c144d0866024e098908bab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.813524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6e431b68c144d0866024e098908bab'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:38.820588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 818/1657] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:38 2022] DELETE /identity/v3/users/bf6e431b68c144d0866024e098908bab => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:38.824685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] MFA Rules not processed for user `2f18c60bc4a944b5b602e9978caaa037`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:38.825950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.886330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:38.927186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.929068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:38.941039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 840/1658] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:38.954373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:38.959685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.054831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c64d-70ac-4c71-9c14-cbe6d259cdb6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.059640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.060899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.061183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.061456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.068556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5370-b4e7-4bbb-8f96-8934d2d9dd6a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.074876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.075775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.076246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.076656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] PATH_INFO: `/v3/projects/d157dca08c7e4931956d42581d908652` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.077260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.078448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d157dca08c7e4931956d42581d908652)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.079550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.080784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.100786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 841/1659] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:39.143447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:39.158771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd157dca08c7e4931956d42581d908652', 'request_id': 'req-d94f18c9-4b01-42b4-a169-5b675c383adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.172890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd157dca08c7e4931956d42581d908652', 'request_id': 'req-d94f18c9-4b01-42b4-a169-5b675c383adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.182345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd157dca08c7e4931956d42581d908652', 'request_id': 'req-d94f18c9-4b01-42b4-a169-5b675c383adb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.207676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:39.209708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.231111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] The token cache is being invalidate because project d157dca08c7e4931956d42581d908652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:39.231614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.232577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.233347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710149b-67d8-473e-be3b-467b0ef0f0d0 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.238144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 819/1660] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:38 2022] DELETE /identity/v3/projects/d157dca08c7e4931956d42581d908652 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:39.240245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:39.246972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.323347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f18c9-4b01-42b4-a169-5b675c383adb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.327340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.328118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.328558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.328975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.332040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.379411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.380406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.381044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.381681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] PATH_INFO: `/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.385326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac6642d855e43ccba7b4f7c9367f6c4)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.391834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.458435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.464058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.509979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 820/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:39.512791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:39.519066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.552786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4126-8e5a-47cb-85a8-e60c231a45a2 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.555455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac6642d855e43ccba7b4f7c9367f6c4', 'request_id': 'req-188f7e3f-32e0-494f-8915-42db5f0bc767'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.570251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac6642d855e43ccba7b4f7c9367f6c4', 'request_id': 'req-188f7e3f-32e0-494f-8915-42db5f0bc767'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.578470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac6642d855e43ccba7b4f7c9367f6c4', 'request_id': 'req-188f7e3f-32e0-494f-8915-42db5f0bc767'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.601261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] The token cache is being invalidate because project dac6642d855e43ccba7b4f7c9367f6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:39.601824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.602797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-188f7e3f-32e0-494f-8915-42db5f0bc767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.606793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 842/1662] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:39 2022] DELETE /identity/v3/projects/dac6642d855e43ccba7b4f7c9367f6c4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:39.612676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbaa7-b975-44b4-a87c-50443a1dff48 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.613183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbaa7-b975-44b4-a87c-50443a1dff48 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.613474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbaa7-b975-44b4-a87c-50443a1dff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.644278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ba5fbaa7-b975-44b4-a87c-50443a1dff48 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:39.645678 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba5fbaa7-b975-44b4-a87c-50443a1dff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.650508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:39.674519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.675520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.676119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.676637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] PATH_INFO: `/v3/users/5e4ad53ae926408986f1f4a99b8ab73d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.678147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4ad53ae926408986f1f4a99b8ab73d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.680360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.706059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:39.728993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 843/1663] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:39.737366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.738050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.738431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.777719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:39.779054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:39.779406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4ad53ae926408986f1f4a99b8ab73d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.780261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4ad53ae926408986f1f4a99b8ab73d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.789410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 844/1664] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:39.794637 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:39.795972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4ad53ae926408986f1f4a99b8ab73d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.804644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed701eec-b362-4374-b390-356f6b09f322 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.811559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.812176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.813243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.813518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.814256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:39.814557 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.816179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.819825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4ad53ae926408986f1f4a99b8ab73d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.834774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4ad53ae926408986f1f4a99b8ab73d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:39.844623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 821/1666] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:39 2022] DELETE /identity/v3/users/5e4ad53ae926408986f1f4a99b8ab73d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:39.846929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 845/1665] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:39.849997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:39.953023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cc936-6520-49f1-a70d-e549054f53d0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:39.958478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:39.959320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:39.959593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:39.959878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:39.960498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:39.962616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:39.997095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 822/1667] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:39 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:39.998641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.009828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f7586-c06e-4564-b793-e19d7798d8d8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.091055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.091668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.091945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.092214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.092846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.094864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.121472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 846/1668] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:39 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:40.125270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.140070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8db63c-5b0d-4993-9613-e16683219bbb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.147015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.147701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.148462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.149268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.149517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.153460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.167384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 823/1669] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:40.171146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.181843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55df2-b718-4eb9-805d-8f6a6bc13463 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.186772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.187546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.187820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.188093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.188732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.190490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.203899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 847/1670] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:40.208430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.219289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de302-6496-4f80-af4d-411e0e5d596f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.225600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.226514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.226881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.227269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] PATH_INFO: `/v3/projects/2ccc04e3ea7d429491274d3c45cd2af6/users/afa964fba2fa415d80c6125287763dde/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.247724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccc04e3ea7d429491274d3c45cd2af6, user_id=afa964fba2fa415d80c6125287763dde, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.250897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86f54-f884-4117-9cf9-ae4fa463957b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.262652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.265045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:40.269613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 824/1671] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:40 2022] PUT /identity/v3/projects/2ccc04e3ea7d429491274d3c45cd2af6/users/afa964fba2fa415d80c6125287763dde/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:40.278669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e82-4663-4a85-92d1-6e3560366763 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.281139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.281414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.281922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.320294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] MFA Rules not processed for user `afa964fba2fa415d80c6125287763dde`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:40.321500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:40.363999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:40.373812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.375033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.375306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.375576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] PATH_INFO: `/v3/projects/2e63159d0675434da1b497ba61186955` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.377327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e63159d0675434da1b497ba61186955)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.379589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.391798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:40.404707 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 825/1672] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:40.409147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.422720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389f18-5610-4c5f-80f1-3d02b14dda0b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.430197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.430835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.431196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.431470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.432168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.435264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.466849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e63159d0675434da1b497ba61186955', 'request_id': 'req-070d3eae-e38d-486a-bb4d-d587102e50f6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:40.478117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e63159d0675434da1b497ba61186955', 'request_id': 'req-070d3eae-e38d-486a-bb4d-d587102e50f6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:40.492621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e63159d0675434da1b497ba61186955', 'request_id': 'req-070d3eae-e38d-486a-bb4d-d587102e50f6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:40.500775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 826/1673] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:40.501934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.516489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] The token cache is being invalidate because project 2e63159d0675434da1b497ba61186955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:40.517182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:40.518231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-070d3eae-e38d-486a-bb4d-d587102e50f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:40.520292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 848/1674] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:40 2022] DELETE /identity/v3/projects/2e63159d0675434da1b497ba61186955 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:40.526522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6baed-319f-435b-a2b7-c604642337d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.526791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6baed-319f-435b-a2b7-c604642337d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.527083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6baed-319f-435b-a2b7-c604642337d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.550544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-add6baed-319f-435b-a2b7-c604642337d8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:40.551910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-add6baed-319f-435b-a2b7-c604642337d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:40.610879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e207e5-64b7-4625-84f2-3931178aaadd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.616249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.617088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.617367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.617683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.619251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.622055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.639119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 849/1675] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:40.648309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.648587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.648859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.666295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 827/1676] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:40.670648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.672653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:40.674190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:40.675368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:40.687306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 850/1677] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:40.687469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53106928-5a82-4de8-a880-01d659c57ead admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.688612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.696686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.697438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.697843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.698232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.698812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e88e-f3de-4983-8587-40ada88a8663 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.699004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.700961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.704741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.705419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.705711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.706028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.706764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:40.707080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.708820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.717160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 828/1678] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:40.718291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.722625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 851/1679] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:40.727867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.730912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2585a9b-38bc-4380-bc92-3e7ff74d98e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.736486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.737307 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.737622 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.737900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] PATH_INFO: `/v3/projects/7e2a241190a64fc8a789a211f11e0576/users/5ef5f3e70b6f48509a41bddaaaa421d7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.744786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb66e-83cc-4235-b9c9-d0861d703b89 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.750994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.751806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.752175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.752560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.753289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.756590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.758312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2a241190a64fc8a789a211f11e0576, user_id=5ef5f3e70b6f48509a41bddaaaa421d7, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.761067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.779212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 829/1680] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:40 2022] PUT /identity/v3/projects/7e2a241190a64fc8a789a211f11e0576/users/5ef5f3e70b6f48509a41bddaaaa421d7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:40.783302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.793924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 852/1681] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:40.799437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.880565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ad27e-dcb7-4f29-9110-adc4bb17d7d0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.883586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:40.888270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3fb37-0e9a-41b3-84a2-cd8384784689 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.892446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.893158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.893551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.894211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.895601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.896091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.896872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.897240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.897647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.898745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.899228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.901871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.920997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 830/1682] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:40.930724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.947955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 853/1683] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:40 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:40.951403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:40.952016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:40.955499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3038-e5b2-4d82-b73b-eb226f9de621 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.962514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.962878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753bf1c-68a2-47fc-90b0-07b4991ff2a4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:40.963930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.964501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.964865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] PATH_INFO: `/v3/projects/7e2a241190a64fc8a789a211f11e0576/users/5ef5f3e70b6f48509a41bddaaaa421d7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.967201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2a241190a64fc8a789a211f11e0576, user_id=5ef5f3e70b6f48509a41bddaaaa421d7, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.967788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:40.968402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:40.968677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:40.968946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:40.969608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:40.971481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.971603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1b43b-503b-4147-9353-7f93080ba154 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:40.983691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 854/1684] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:40.990297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.000032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 831/1685] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:40 2022] PUT /identity/v3/projects/7e2a241190a64fc8a789a211f11e0576/users/5ef5f3e70b6f48509a41bddaaaa421d7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:41.010457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.010903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.011245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.011719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c888-d32b-43da-a409-1a16fa70c1de admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.044426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] MFA Rules not processed for user `5ef5f3e70b6f48509a41bddaaaa421d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:41.045766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:41.102415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.103283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.103697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.104100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.104888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.106515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.121969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 855/1686] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:41.123155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.137472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b249f0-5395-4e9b-a2c1-99e9c094bc32 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.154071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.154940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.154940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.155727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] PATH_INFO: `/v3/projects/811b0680dc5d49db829d03295fcec747/users/cd7ef291d12b40bbabcd25d2e8ff425b/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.161992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 832/1687] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:41.173437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.175054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:41.175670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b0680dc5d49db829d03295fcec747, user_id=cd7ef291d12b40bbabcd25d2e8ff425b, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.178535 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cab50-0638-40fa-99ad-1105cc088193 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.197730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 856/1688] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:41 2022] PUT /identity/v3/projects/811b0680dc5d49db829d03295fcec747/users/cd7ef291d12b40bbabcd25d2e8ff425b/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:41.211089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.211624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.212080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.268091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] MFA Rules not processed for user `cd7ef291d12b40bbabcd25d2e8ff425b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:41.269564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:41.324185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2390f3-99de-4350-9860-53197af10b78 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.357851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 857/1689] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:41.360379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.401872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.402770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.403837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.404122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.415967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:41.469135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccbd3e-0a82-4939-8493-766808abfeef None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.473941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:41.476223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.477032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.477359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.477674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.478417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.482717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.507594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.509478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.522924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 833/1690] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:41.524921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 858/1691] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:41 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:41.537165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.561820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f310-3d0b-4ca4-9524-67272e56ac1e service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.638644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.639284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.639597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.639922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.640593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.642788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.669994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 834/1692] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:41 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:41.674377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.687304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a846-f1b6-46ad-a17b-e7aa24604cd9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.696128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.696934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.697433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.697818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.698848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.701025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.713634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 859/1693] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:41.718963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.731164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1e791-d7dc-429a-8bed-57dd33f90fd7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.741072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.741819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.742125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.743069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] PATH_INFO: `/v3/projects/50469556e4b44bcdb65663943bc47acc/users/f2363aa94ff54b29bd9fab419b1208bd/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.761640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=50469556e4b44bcdb65663943bc47acc, user_id=f2363aa94ff54b29bd9fab419b1208bd, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.764289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.786516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 835/1694] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:41 2022] PUT /identity/v3/projects/50469556e4b44bcdb65663943bc47acc/users/f2363aa94ff54b29bd9fab419b1208bd/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:41.789464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.805271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe5b88-e3f5-480c-9047-e91a14b7e8eb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.884405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.884966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.885240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.885502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.886181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.887753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a577b-3340-46c8-a295-ac55f8debaf9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.898606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 860/1695] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:41.902554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:41.913988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16376e4-b7a5-45ca-85a4-315d854461aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:41.918929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:41.920723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.920723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.920723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] PATH_INFO: `/v3/projects/50469556e4b44bcdb65663943bc47acc/users/f2363aa94ff54b29bd9fab419b1208bd/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.922630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50469556e4b44bcdb65663943bc47acc, user_id=f2363aa94ff54b29bd9fab419b1208bd, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:41.926183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:41.937935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 836/1696] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:41 2022] PUT /identity/v3/projects/50469556e4b44bcdb65663943bc47acc/users/f2363aa94ff54b29bd9fab419b1208bd/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:41.951384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:41.951742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:41.952055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:41.987231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] MFA Rules not processed for user `f2363aa94ff54b29bd9fab419b1208bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:41.988562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.102015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:42.128935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 861/1697] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:42.148225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:42.183556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eed2-86b5-4d69-9bba-a6d01de6ca6d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:42.190259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:42.191080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.191511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.191785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] PATH_INFO: `/v3/users/afa964fba2fa415d80c6125287763dde` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.193134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa964fba2fa415d80c6125287763dde)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:42.194201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:42.196278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:42.220730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa0cf-ba2d-4e13-bcd1-25479ebf8c33 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:42.224699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:42.225312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.225621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.225895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.248866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:42.267609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa964fba2fa415d80c6125287763dde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.268456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa964fba2fa415d80c6125287763dde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.281451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa964fba2fa415d80c6125287763dde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.314688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa964fba2fa415d80c6125287763dde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.325277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:42.327640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab272bcb-2278-4d92-81ee-dd529cf27497 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:42.335037 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa964fba2fa415d80c6125287763dde'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.341012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 862/1698] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:42.344933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 837/1699] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:42 2022] DELETE /identity/v3/users/afa964fba2fa415d80c6125287763dde => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:42.349923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.350206 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.350527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.373692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:42.375261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.471791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 863/1700] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:42.481185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:42.482639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.487839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:42.489573 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.505970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a236-54c1-4983-9d9e-db7e858f5ae9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:42.511065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:42.511761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.512039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.512314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] PATH_INFO: `/v3/users/9ecc0961a88f409fbce226f9143da7e6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.513809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecc0961a88f409fbce226f9143da7e6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:42.516162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:42.594006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729543-1d1b-4c9c-ad0c-3e07eeb9d937 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:42.598346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecc0961a88f409fbce226f9143da7e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.600233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecc0961a88f409fbce226f9143da7e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.602951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:42.605310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.605310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.605310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.609114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.617346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecc0961a88f409fbce226f9143da7e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.632853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:42.634519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de74c3-2993-415a-a505-2d4b2376f18d service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:42.647386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 864/1701] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:42.647756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecc0961a88f409fbce226f9143da7e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.655371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecc0961a88f409fbce226f9143da7e6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:42.662527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 838/1702] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:42 2022] DELETE /identity/v3/users/9ecc0961a88f409fbce226f9143da7e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:42.667408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.667837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.668291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:42.703271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:42.705060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.746156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:42.825843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 865/1703] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:42.847641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:42.849531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:42.982779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb9072-e74c-4d95-b337-f0d4a69e0b52 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:42.987643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:42.988659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:42.988952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:42.989199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:43.002553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:43.004383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:43.019967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 839/1704] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:43.913216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:43.914718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:43.932663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720034af-dd55-4f8d-9dcc-f3ab96e15bbf None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:43.941424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:43.942225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:43.944677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:43.945080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] PATH_INFO: `/v3/projects/2ccc04e3ea7d429491274d3c45cd2af6` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:43.947223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccc04e3ea7d429491274d3c45cd2af6)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:43.949233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:44.091954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccc04e3ea7d429491274d3c45cd2af6', 'request_id': 'req-9c27f251-3825-44f2-8378-ce37ad0344a4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.103216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccc04e3ea7d429491274d3c45cd2af6', 'request_id': 'req-9c27f251-3825-44f2-8378-ce37ad0344a4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.110620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccc04e3ea7d429491274d3c45cd2af6', 'request_id': 'req-9c27f251-3825-44f2-8378-ce37ad0344a4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.133008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] The token cache is being invalidate because project 2ccc04e3ea7d429491274d3c45cd2af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:44.133375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.134018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.137162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 866/1705] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:43 2022] DELETE /identity/v3/projects/2ccc04e3ea7d429491274d3c45cd2af6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:44.142086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:44.163306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a79df-24e0-4af3-a87e-53eccc322b23 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:44.216930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:44.307487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:44.308161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:44.308443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:44.308719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] PATH_INFO: `/v3/users/5ef5f3e70b6f48509a41bddaaaa421d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:44.313073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef5f3e70b6f48509a41bddaaaa421d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:44.315156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:44.421149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef5f3e70b6f48509a41bddaaaa421d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.422073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef5f3e70b6f48509a41bddaaaa421d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.467211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef5f3e70b6f48509a41bddaaaa421d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.524896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef5f3e70b6f48509a41bddaaaa421d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.561376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef5f3e70b6f48509a41bddaaaa421d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:44.579710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 840/1706] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:44 2022] DELETE /identity/v3/users/5ef5f3e70b6f48509a41bddaaaa421d7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:45.020439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.022023 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.037711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f251-3825-44f2-8378-ce37ad0344a4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:45.122954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:45.123918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:45.124058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:45.124299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] PATH_INFO: `/v3/projects/05d0b036cf2f4f30ad9ed0d1c1328064` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:45.125767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d0b036cf2f4f30ad9ed0d1c1328064)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:45.127809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:45.183542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d0b036cf2f4f30ad9ed0d1c1328064', 'request_id': 'req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.195062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d0b036cf2f4f30ad9ed0d1c1328064', 'request_id': 'req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.196922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:45.204333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d0b036cf2f4f30ad9ed0d1c1328064', 'request_id': 'req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.217624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] The token cache is being invalidate because project 05d0b036cf2f4f30ad9ed0d1c1328064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:45.217835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.218493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.220025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 867/1707] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:45 2022] DELETE /identity/v3/projects/05d0b036cf2f4f30ad9ed0d1c1328064 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:45.224291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.225750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.238675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88e9f-be30-4c69-9be0-b224c1e8fb28 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:45.297528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:45.298282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:45.298648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:45.298972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] PATH_INFO: `/v3/users/2f18c60bc4a944b5b602e9978caaa037` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:45.300164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f18c60bc4a944b5b602e9978caaa037)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:45.302382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:45.376280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f18c60bc4a944b5b602e9978caaa037'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.377482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f18c60bc4a944b5b602e9978caaa037'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.385053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:45.394607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.396945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.397411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f18c60bc4a944b5b602e9978caaa037'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.412139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda7fd-a03d-42b7-8f08-3207e5475fd2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:45.417560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:45.418780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:45.418968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:45.419232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] PATH_INFO: `/v3/users/cd7ef291d12b40bbabcd25d2e8ff425b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:45.420764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7ef291d12b40bbabcd25d2e8ff425b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:45.421090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f18c60bc4a944b5b602e9978caaa037'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.422757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:45.430750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63d146-c9f1-4d1a-b7cb-8513c0f8915f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f18c60bc4a944b5b602e9978caaa037'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.441986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 841/1708] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:45 2022] DELETE /identity/v3/users/2f18c60bc4a944b5b602e9978caaa037 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:45.493962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7ef291d12b40bbabcd25d2e8ff425b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.505215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7ef291d12b40bbabcd25d2e8ff425b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.524626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7ef291d12b40bbabcd25d2e8ff425b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.526130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7ef291d12b40bbabcd25d2e8ff425b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.539001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7ef291d12b40bbabcd25d2e8ff425b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.549863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 868/1709] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:45 2022] DELETE /identity/v3/users/cd7ef291d12b40bbabcd25d2e8ff425b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:45.555231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:45.555597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:45.555886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:45.582893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.584165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:45.585752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.586022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.717477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79cc4-cd96-4788-ae35-6e83aba8c595 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:45.725930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:45.726601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:45.726953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:45.727229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] PATH_INFO: `/v3/projects/7e2a241190a64fc8a789a211f11e0576` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:45.728739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2a241190a64fc8a789a211f11e0576)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:45.731183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:45.738267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 842/1710] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:45.754252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.757758 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.847248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2a241190a64fc8a789a211f11e0576', 'request_id': 'req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.875421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2a241190a64fc8a789a211f11e0576', 'request_id': 'req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.878772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:45.889645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2a241190a64fc8a789a211f11e0576', 'request_id': 'req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.911117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] The token cache is being invalidate because project 7e2a241190a64fc8a789a211f11e0576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:45.911721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.912706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:45.915026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 869/1711] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:45 2022] DELETE /identity/v3/projects/7e2a241190a64fc8a789a211f11e0576 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:45.920396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:45.922600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:45.937884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248c4c-1ea9-4625-be8e-fba451333724 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.003864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.005016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.005016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.005187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.007327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:46.064825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ba70-70b6-43e1-ba7b-f08b3675686c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.072744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.074824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.075330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.075858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] PATH_INFO: `/v3/projects/7e4eb056eda345b7ab7be4955cca4c81` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.077430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4eb056eda345b7ab7be4955cca4c81)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.077891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:46.082060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.120007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.121493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf2190-69d9-41ec-afe6-5b8a8fd927f8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.133919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 843/1712] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:46.136059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71602f-2326-492a-b8ea-9b08733d0f1e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.136992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71602f-2326-492a-b8ea-9b08733d0f1e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.137380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71602f-2326-492a-b8ea-9b08733d0f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.162575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df71602f-2326-492a-b8ea-9b08733d0f1e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:46.163717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df71602f-2326-492a-b8ea-9b08733d0f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:46.173891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4eb056eda345b7ab7be4955cca4c81', 'request_id': 'req-e432d70e-1f56-43ea-8d15-9e49dec0896a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:46.220632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4eb056eda345b7ab7be4955cca4c81', 'request_id': 'req-e432d70e-1f56-43ea-8d15-9e49dec0896a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:46.247072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4eb056eda345b7ab7be4955cca4c81', 'request_id': 'req-e432d70e-1f56-43ea-8d15-9e49dec0896a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:46.269207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] The token cache is being invalidate because project 7e4eb056eda345b7ab7be4955cca4c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:46.269903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:46.271012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e432d70e-1f56-43ea-8d15-9e49dec0896a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:46.277608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 870/1713] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:45 2022] DELETE /identity/v3/projects/7e4eb056eda345b7ab7be4955cca4c81 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:46.280651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cb1e-96cf-4ab6-a078-13b759b80bb5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.281568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cb1e-96cf-4ab6-a078-13b759b80bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.283325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cb1e-96cf-4ab6-a078-13b759b80bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.324259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8ef0cb1e-96cf-4ab6-a078-13b759b80bb5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:46.325364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 844/1714] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:46.331015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8ef0cb1e-96cf-4ab6-a078-13b759b80bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:46.333812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.334315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.334937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.354273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 871/1715] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:46.356090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.356381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.356660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.365083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:46.366870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:46.381489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:46.383848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:46.385357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 845/1716] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:46.393849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.402646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 872/1717] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:46.404026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.405847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2765a1-bb15-4929-b43a-0d66ec42ae1b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.410836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.411635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.411989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.412354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.413139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:46.413542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.415503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.425570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd50040-4b08-4423-b981-31a3012fccc0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.431523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 846/1718] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:46.436438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.442561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.460555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a36afa-1875-4d8e-b31a-905a01beb717 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.464291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.464581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.464854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.467270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:46.467588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.469629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.476603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.477572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.477926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.478250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.478923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.485471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.501816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 873/1719] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:46.506853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.539061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423e3e4-a345-4a32-8d0b-0574d6d421a1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.556095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.557404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 847/1720] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:46.560802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.561117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.561406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.562122 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.564259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.566693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.626675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 874/1721] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/projects => generated 407 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:46.631338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.703185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:46.716996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152a545-7c5d-4a31-92bf-2ce697c6686f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.767574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0e27-71f4-46c4-9e35-86544228d5a1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.773536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.774892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.775341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.775751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.776586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.779175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.806198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:46.833927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 875/1722] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/users => generated 304 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:46.838096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.857115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a67ef-427d-4fcf-a644-c7696b89a599 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.864537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.865815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.865815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.866011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.866981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.868962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.875356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.876003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.876274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.876544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.879376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.883450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 876/1723] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:46.886644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.887924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.915174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853326-2114-4cdc-a289-af6a9b7ddc9e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.923172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.929479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.930764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.931287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.934020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.935716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 848/1724] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:46 2022] POST /identity/v3/users => generated 288 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:46.935969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.939019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.962068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720aa5-04a0-4b8a-adf4-7553694629c4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.964123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 877/1725] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:46.967640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:46.976585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.977459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.978404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.978547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.981090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:46.982861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:46.983474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984a270-5017-4681-b20e-531c77169e88 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:46.989413 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:46.990282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:46.990643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:46.991005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] PATH_INFO: `/v3/projects/a6987a82b2814a4e812b3bc5dfbc10c0/users/3c8001ff148746d08e18dd701f5a39d1/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:46.999300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 849/1726] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:47.005033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.016536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6987a82b2814a4e812b3bc5dfbc10c0, user_id=3c8001ff148746d08e18dd701f5a39d1, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.020677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce33c0-8544-483c-9b9d-a5d2455c31df admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.021204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69400-08fa-42a4-9034-bc2bd1f8b850 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.027998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.031417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.031417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.031417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.031417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.033162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.046124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 878/1727] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:46 2022] PUT /identity/v3/projects/a6987a82b2814a4e812b3bc5dfbc10c0/users/3c8001ff148746d08e18dd701f5a39d1/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:47.057270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.057856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.058341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.060401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 850/1728] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:47.065367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.080104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c32c-a019-4f7e-a1e6-a874e1814e39 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.101623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] MFA Rules not processed for user `3c8001ff148746d08e18dd701f5a39d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:47.107600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:47.178135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.179138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.179585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.180312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] PATH_INFO: `/v3/projects/d0cbe8d68c3d46afa98e949617d62cad/users/7f9dab7578724e63985f476a5fe4d3b3/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.201544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cbe8d68c3d46afa98e949617d62cad, user_id=7f9dab7578724e63985f476a5fe4d3b3, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.204664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf06903-5fa8-4bc3-ab6f-e5fe1e884f43 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.232035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 851/1729] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:47 2022] PUT /identity/v3/projects/d0cbe8d68c3d46afa98e949617d62cad/users/7f9dab7578724e63985f476a5fe4d3b3/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:47.245232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.245674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.245877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.258906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 879/1730] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:47.263618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.289321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704d0c-6686-4fb4-a439-7a50c3287f4f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.317164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] MFA Rules not processed for user `7f9dab7578724e63985f476a5fe4d3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:47.320824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:47.393932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.394938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.395363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.395646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.397989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.400824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.408332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:47.438451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 852/1731] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:47.454058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 880/1732] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:47 2022] POST /identity/v3/projects => generated 409 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:47.458206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.471799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.475966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c265b9-18fc-40e2-8c2e-6c16a423331e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.478013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:47.530517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:47.609100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ef95b-ee0d-441b-a818-0ca4812c473d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.614327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.614962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.615240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.615512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.630998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.632971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.637892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.638538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.638816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.639086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.681522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 853/1733] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:47 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:47.685317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.703453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64ffc-ceed-40fa-9eb8-9e1c7129bc89 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.715776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.720844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.721156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.721609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.723602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.725263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.745678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 854/1734] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:47.749815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.755824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.758077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.763835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd333f5-314d-40f7-ba16-e855c2665eaa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.770258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.770396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 881/1735] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:47.771216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.771498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.771772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] PATH_INFO: `/v3/projects/0edbe88a84964f2498e8bc8bf2563693/users/76a7d2ae1e17488487f69b7764ffa210/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.793624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edbe88a84964f2498e8bc8bf2563693, user_id=76a7d2ae1e17488487f69b7764ffa210, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.796546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.819350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 855/1736] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:47 2022] PUT /identity/v3/projects/0edbe88a84964f2498e8bc8bf2563693/users/76a7d2ae1e17488487f69b7764ffa210/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:47.821348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.836944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6020-4f53-4ace-b3f8-cfdc54bb591c service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.930337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.931134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.931657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.932061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.933070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.934885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6adaa8-e970-41fe-88fb-b5d4f65b17a6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.950332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 882/1737] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:47.951201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:47.964760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780362f-e0be-4a96-b508-e65833cfb933 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:47.970406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:47.971312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:47.971692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:47.972158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] PATH_INFO: `/v3/projects/0edbe88a84964f2498e8bc8bf2563693/users/76a7d2ae1e17488487f69b7764ffa210/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:47.976267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edbe88a84964f2498e8bc8bf2563693, user_id=76a7d2ae1e17488487f69b7764ffa210, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:47.979448 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:47.995047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 856/1738] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:47 2022] PUT /identity/v3/projects/0edbe88a84964f2498e8bc8bf2563693/users/76a7d2ae1e17488487f69b7764ffa210/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:48.007042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:48.007432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:48.007808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:48.047775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] MFA Rules not processed for user `76a7d2ae1e17488487f69b7764ffa210`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:48.049463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:48.126982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:48.131729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:48.135563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:48.285292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 883/1739] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:48.310671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:48.314799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a84d1-0c83-44c1-8639-73c673559059 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:48.335167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:48.335847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:48.336276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:48.336555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] PATH_INFO: `/v3/projects/811b0680dc5d49db829d03295fcec747` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:48.337976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811b0680dc5d49db829d03295fcec747)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:48.340145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:48.419533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811b0680dc5d49db829d03295fcec747', 'request_id': 'req-7b5dbcd3-e973-4555-b50a-01373f4b92f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.442881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811b0680dc5d49db829d03295fcec747', 'request_id': 'req-7b5dbcd3-e973-4555-b50a-01373f4b92f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.448630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:48.456422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811b0680dc5d49db829d03295fcec747', 'request_id': 'req-7b5dbcd3-e973-4555-b50a-01373f4b92f8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.458550 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10cc1-f2bc-4245-86bc-a694977c18a7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:48.488802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] The token cache is being invalidate because project 811b0680dc5d49db829d03295fcec747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:48.490159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.491042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.493703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 857/1740] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:48 2022] DELETE /identity/v3/projects/811b0680dc5d49db829d03295fcec747 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:48.499480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:48.503071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:48.538199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:48.542704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:48.543303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:48.544016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:48.550838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:48.609020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dbcd3-e973-4555-b50a-01373f4b92f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:48.622217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:48.623328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:48.624358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:48.624825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] PATH_INFO: `/v3/users/f2363aa94ff54b29bd9fab419b1208bd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:48.626623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2363aa94ff54b29bd9fab419b1208bd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:48.630074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:48.637384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:48.638503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:48.649685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 884/1741] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:48.735062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2363aa94ff54b29bd9fab419b1208bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.735743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2363aa94ff54b29bd9fab419b1208bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.756979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2363aa94ff54b29bd9fab419b1208bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.772452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2363aa94ff54b29bd9fab419b1208bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.801565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2363aa94ff54b29bd9fab419b1208bd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:48.808460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 858/1742] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:48 2022] DELETE /identity/v3/users/f2363aa94ff54b29bd9fab419b1208bd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:48.885927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:48.887377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:48.909544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e889-2cb8-4781-b42a-3711a9817c33 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:48.960624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:49.020079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:49.020829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.021179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.021518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.023831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:49.123531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:49.125365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f2bf-707b-44a3-a2c2-31a4b50d2bcf service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:49.155634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 885/1743] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:49.325082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:49.326944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:49.491779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34296de-a9d8-4d76-b8a7-ff9ec98bc4ea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:49.506891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:49.508073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.508420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.508715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] PATH_INFO: `/v3/projects/50469556e4b44bcdb65663943bc47acc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.510358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50469556e4b44bcdb65663943bc47acc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:49.512692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:49.526813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:49.586672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50469556e4b44bcdb65663943bc47acc', 'request_id': 'req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:49.599181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50469556e4b44bcdb65663943bc47acc', 'request_id': 'req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:49.606612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50469556e4b44bcdb65663943bc47acc', 'request_id': 'req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:49.619277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] The token cache is being invalidate because project 50469556e4b44bcdb65663943bc47acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:49.619618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:49.620309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-51c1aafd-ff53-4687-bfb4-2d3b6b9e0467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:49.621921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 859/1744] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:49 2022] DELETE /identity/v3/projects/50469556e4b44bcdb65663943bc47acc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:49.627498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.627801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.628080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.658390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:49.660168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:49.739974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 886/1745] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:49.741531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.741848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.742127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.773964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:49.775206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:49.796165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 860/1746] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:49.796675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:49.807771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667ca5-28fd-4496-aa36-776e4975ec63 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:49.814697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:49.815345 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.815619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.816053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.816682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:49.817054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:49.818805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:49.863948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 887/1747] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:49.871341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:49.882338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ba357-6c26-49f8-b66e-784aaabfa1f4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:49.887465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:49.888086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:49.888366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:49.888635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:49.889280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:49.891264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:49.932317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 861/1748] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:49 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:49.933272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:49.947290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1971fe-ac84-439a-a88a-84392b4402e5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:50.041697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:50.042711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.043296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.044558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.045570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:50.047946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:50.073689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:50.085694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 888/1749] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:49 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:50.086981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:50.098970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e16cc-2b2d-4270-b36f-84f159e7a1c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:50.105549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:50.106526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.106851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.107157 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.107873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:50.109845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:50.124077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 862/1750] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:50.127726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:50.138777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae04-83a0-4aac-a441-9137c459689a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:50.144727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:50.145382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.145688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.146021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.146675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:50.148313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335eed1-f3fd-4ba8-8d9b-678dbe5fadca admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:50.163484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 889/1751] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:50.165466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:50.175887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288fdc-f50f-4f6d-a4e7-cd6a54b17bff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:50.180993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:50.181751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.182105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.182302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] PATH_INFO: `/v3/projects/068a46a3f6e745fe81b112db925754a6/users/60c71f557b8840c8901e59903ccef9fc/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.209191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] RBAC: Authorizing `identity:create_grant(project_id=068a46a3f6e745fe81b112db925754a6, user_id=60c71f557b8840c8901e59903ccef9fc, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:50.212281 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:50.229734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 863/1752] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:50 2022] PUT /identity/v3/projects/068a46a3f6e745fe81b112db925754a6/users/60c71f557b8840c8901e59903ccef9fc/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:50.240817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.241049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.241514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.275598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] MFA Rules not processed for user `60c71f557b8840c8901e59903ccef9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:50.276930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:50.345708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 890/1753] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:50.356796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:50.359122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:50.419115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84801-57dd-43d3-8c14-cd835b3c855f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:50.422923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:50.423533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:50.423812 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:50.424086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:50.436695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:50.438704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49fab7-7dea-40f8-813a-7af4f8c042dd service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:50.451370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 864/1754] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:51.288007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:51.289490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:51.363227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003bdb-c000-4198-adc5-b5610e7b7a6f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:51.368766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:51.369623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:51.369829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:51.370197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] PATH_INFO: `/v3/users/7f9dab7578724e63985f476a5fe4d3b3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:51.371518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9dab7578724e63985f476a5fe4d3b3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:51.373443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:51.433959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9dab7578724e63985f476a5fe4d3b3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:51.442981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9dab7578724e63985f476a5fe4d3b3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:51.458068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9dab7578724e63985f476a5fe4d3b3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:51.458794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9dab7578724e63985f476a5fe4d3b3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:51.467484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9dab7578724e63985f476a5fe4d3b3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:51.468954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:51.474734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 891/1755] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:51 2022] DELETE /identity/v3/users/7f9dab7578724e63985f476a5fe4d3b3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:51.479684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:51.480178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:51.480267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:51.500186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:51.501392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:51.536468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:51.564876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 865/1756] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:51.574792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:51.576302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:51.640645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443a78-0ac9-46be-8366-29e50e890af3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:51.648102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:51.649291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:51.649628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:51.650103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:51.660168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:51.661653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825f780-000c-4a42-949f-66a17698d82c service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:51.671902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 892/1757] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:44:51.967565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:51.968916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:51.994329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7058da-e6ef-43b5-a5c7-791e68462ede None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.002697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.003804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.004572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.004745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] PATH_INFO: `/v3/projects/d0cbe8d68c3d46afa98e949617d62cad` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.006200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cbe8d68c3d46afa98e949617d62cad)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.008388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.078715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cbe8d68c3d46afa98e949617d62cad', 'request_id': 'req-55b33270-4996-4a3d-9915-0dbc493b15b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:52.088609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cbe8d68c3d46afa98e949617d62cad', 'request_id': 'req-55b33270-4996-4a3d-9915-0dbc493b15b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:52.109558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cbe8d68c3d46afa98e949617d62cad', 'request_id': 'req-55b33270-4996-4a3d-9915-0dbc493b15b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:52.122418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] The token cache is being invalidate because project d0cbe8d68c3d46afa98e949617d62cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:52.122702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:52.123385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-55b33270-4996-4a3d-9915-0dbc493b15b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:52.125163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 866/1758] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:51 2022] DELETE /identity/v3/projects/d0cbe8d68c3d46afa98e949617d62cad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:52.132417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.132417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.132417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.165285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:52.167010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:52.249632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 893/1759] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:52.259374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.259859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.260215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.280978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:52.282241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:52.291420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 867/1760] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:52.296590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.307125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c0e88-cb00-466a-a9dc-30ba832b17a0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.312030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.312673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.312973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.313276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.313961 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:52.314267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.316115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.329619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 894/1761] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:52.333851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.343371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32663d6-a278-41b6-a39a-1941be86e3c9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.348790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.349318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.349614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.349889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.350522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.352501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.393247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 868/1762] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:52 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:52.394877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.406388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cc8c-e3d0-4bb2-8e98-b5c101bc14b9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.486633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.487301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.487654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.487930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.488575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.490634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.513363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 895/1763] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:52 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:44:52.517261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.528298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10a3c9-ee73-4c1d-ade5-c9b50104e71b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.533090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.533811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.534085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.534358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.535058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.536809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.547104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 869/1764] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:52.551781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.565849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905b2e-dcca-4fc1-bb70-abba2befef14 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.570430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.571046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.571321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.571592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.572242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.573858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2a0d-405e-421e-b50e-271e69637478 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.585374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 896/1765] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:52.589461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.600209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfb35-69c2-456d-b0b6-aa2671668d5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.605162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.605860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.606141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.606415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] PATH_INFO: `/v3/projects/ab6e611f93ce4c57964417d89b6c3e14/users/5fa576bcd66d4c82b20dfc005eb08a39/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.622389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6e611f93ce4c57964417d89b6c3e14, user_id=5fa576bcd66d4c82b20dfc005eb08a39, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.625212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.640229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 870/1766] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:52 2022] PUT /identity/v3/projects/ab6e611f93ce4c57964417d89b6c3e14/users/5fa576bcd66d4c82b20dfc005eb08a39/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:52.645569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb95-e118-46a1-b7be-4dfd0973d6c8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.645877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb95-e118-46a1-b7be-4dfd0973d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.646192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb95-e118-46a1-b7be-4dfd0973d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.659870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:52.666302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e21fbb95-e118-46a1-b7be-4dfd0973d6c8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:52.668270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e21fbb95-e118-46a1-b7be-4dfd0973d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:52.742925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 897/1767] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:52.753677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:52.756406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:52.833118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4819-7d3c-468e-8bbd-7142e5d9366f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:52.836970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:52.837615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:52.837889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:52.838158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:52.849056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:52.850730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:52.861033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 871/1768] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:54.274379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:54.275015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:54.275015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:54.326739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] MFA Rules not processed for user `5fa576bcd66d4c82b20dfc005eb08a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:54.328092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:54.483586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 898/1769] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:54.497632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:54.500006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:54.519459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:54.597822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdfe7-4e9b-449c-bfc6-a3fb685c2e8b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:54.602158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:54.602912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:54.603198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:54.603476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:54.626468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:54.628296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518ceb7-c804-43f2-a6bf-7bd03829e025 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:54.663097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 872/1770] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:55.008116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:55.010252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:55.037267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7d25f-abcb-4495-99dc-0549edbfe33e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:55.061838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:55.062759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:55.064666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:55.067232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] PATH_INFO: `/v3/users/3c8001ff148746d08e18dd701f5a39d1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:55.070031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8001ff148746d08e18dd701f5a39d1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:55.076696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:55.223366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8001ff148746d08e18dd701f5a39d1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:55.250852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8001ff148746d08e18dd701f5a39d1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:55.288198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8001ff148746d08e18dd701f5a39d1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:55.289558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8001ff148746d08e18dd701f5a39d1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:55.317350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8001ff148746d08e18dd701f5a39d1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:55.327934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 899/1771] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:55 2022] DELETE /identity/v3/users/3c8001ff148746d08e18dd701f5a39d1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:55.332358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:55.332641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:55.332917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:55.359588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:55.361108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:55.479949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 873/1772] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:55.491526 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:55.493985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:55.517854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:55.587444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2534b-8bdd-4927-99f5-44c25e920e52 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:55.592294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:55.593028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:55.593309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:55.593587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:55.606470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:55.608911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:55.619778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 900/1773] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:56.107034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:56.108464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:56.121662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0ec8-002d-4f07-b20e-cdc58bf3e2bc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:56.127204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:56.128033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:56.128636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:56.128915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] PATH_INFO: `/v3/projects/a6987a82b2814a4e812b3bc5dfbc10c0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:56.130244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6987a82b2814a4e812b3bc5dfbc10c0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:56.138369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:56.251156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6987a82b2814a4e812b3bc5dfbc10c0', 'request_id': 'req-3fe13a26-420e-4340-8f54-e00fc0f27739'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.268057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6987a82b2814a4e812b3bc5dfbc10c0', 'request_id': 'req-3fe13a26-420e-4340-8f54-e00fc0f27739'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.285743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6987a82b2814a4e812b3bc5dfbc10c0', 'request_id': 'req-3fe13a26-420e-4340-8f54-e00fc0f27739'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.294001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] The token cache is being invalidate because project a6987a82b2814a4e812b3bc5dfbc10c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:56.294297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.295095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe13a26-420e-4340-8f54-e00fc0f27739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.296774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 874/1774] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:56 2022] DELETE /identity/v3/projects/a6987a82b2814a4e812b3bc5dfbc10c0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:56.301902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:56.308318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:56.308853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:56.309474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:56.316618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b3089-97a2-45a5-b090-91bddc8f7bea service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:56.346149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] MFA Rules not processed for user `5fa576bcd66d4c82b20dfc005eb08a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:56.348811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:56.437468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:56.471968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:56.473375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:56.476293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:56.476722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] PATH_INFO: `/v3/users/76a7d2ae1e17488487f69b7764ffa210` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:56.480416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a7d2ae1e17488487f69b7764ffa210)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:56.486099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:56.526222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 875/1775] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:56.588606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a7d2ae1e17488487f69b7764ffa210'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.601308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a7d2ae1e17488487f69b7764ffa210'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.621465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a7d2ae1e17488487f69b7764ffa210'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.622395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a7d2ae1e17488487f69b7764ffa210'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.630925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f3a27e1a-f6c5-49a9-8190-70577abc0cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a7d2ae1e17488487f69b7764ffa210'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:56.637417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 901/1776] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:56 2022] DELETE /identity/v3/users/76a7d2ae1e17488487f69b7764ffa210 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:56.978471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:56.980077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:57.011916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89e07-28a5-4044-8463-da93ca2422c7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.089145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.089898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.090240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.090646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] PATH_INFO: `/v3/projects/0edbe88a84964f2498e8bc8bf2563693` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.091856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edbe88a84964f2498e8bc8bf2563693)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.094138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.154733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edbe88a84964f2498e8bc8bf2563693', 'request_id': 'req-65fa2332-7dc6-486b-9069-398faf855a4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:57.165121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edbe88a84964f2498e8bc8bf2563693', 'request_id': 'req-65fa2332-7dc6-486b-9069-398faf855a4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:57.173999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edbe88a84964f2498e8bc8bf2563693', 'request_id': 'req-65fa2332-7dc6-486b-9069-398faf855a4e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:57.188620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] The token cache is being invalidate because project 0edbe88a84964f2498e8bc8bf2563693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:57.188926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:57.189755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-65fa2332-7dc6-486b-9069-398faf855a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:57.191832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 876/1777] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:56 2022] DELETE /identity/v3/projects/0edbe88a84964f2498e8bc8bf2563693 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:57.196802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.197226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.197828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.221897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:57.223292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:57.257010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:57.297517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 902/1778] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:57.305849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.306236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.306514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.328565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:57.332137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:57.348626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 877/1779] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:57.353525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.363778 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53facd5a-0dc5-4994-809c-beba07a7c0fe None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.368885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.369607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.369949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.370288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.371011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:57.371383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.373041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.385876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 903/1780] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:44:57.390024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.399786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923889e-86bb-4c2a-a728-d059125e3c4b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.405319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.405967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.407011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.407011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.407193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.409291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.440166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 878/1781] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:57 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:57.455272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.472742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8573a-a45f-425f-b992-1c1df454009d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.595922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.596493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.596812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.597218 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.597963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.600105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.647038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 904/1782] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:57 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:57.653146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.678830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e6bd-642f-4840-8d09-907410394689 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.686792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.687500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.687883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.688038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.688686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.690337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.708262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 879/1783] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:57.709931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.724965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e65c-ce55-4249-86b2-cc653eea1b36 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.730165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.730803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.731095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.731351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.731994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.733745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a569e-2b58-4079-8f77-a57841f85bb8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.755802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 905/1784] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:57.760479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:57.775430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f687d2-7056-4073-9502-59d54fd6d187 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:57.782121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:57.783035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.783442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.783938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] PATH_INFO: `/v3/projects/e3bd3adf1023489da16f9d8cf71fe19a/users/95a26ae6de8646cb99f3c372413f853e/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.807826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bd3adf1023489da16f9d8cf71fe19a, user_id=95a26ae6de8646cb99f3c372413f853e, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:57.811720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:57.829331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:57.843995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 880/1785] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:57 2022] PUT /identity/v3/projects/e3bd3adf1023489da16f9d8cf71fe19a/users/95a26ae6de8646cb99f3c372413f853e/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:57.854231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695ca2-3d09-4357-b307-6e588e160a28 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:57.854880 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695ca2-3d09-4357-b307-6e588e160a28 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:57.855446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695ca2-3d09-4357-b307-6e588e160a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:57.892123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-86695ca2-3d09-4357-b307-6e588e160a28 None None] MFA Rules not processed for user `95a26ae6de8646cb99f3c372413f853e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:57.893513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-86695ca2-3d09-4357-b307-6e588e160a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:58.025133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 906/1786] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:58.038496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:58.040918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:58.241009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60801-67ef-4cdc-afe6-b619e0a77666 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:58.245800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:58.246871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.247303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.247717 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.267457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:58.269474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d3b8-b4af-475b-bdcc-a2cdfc4c56bf service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:58.280499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 881/1787] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:58.382326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.383436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.384862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.392533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 907/1788] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:44:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:44:58.416456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405950-ea99-4b9b-b500-05a9d33ab112 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.416737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405950-ea99-4b9b-b500-05a9d33ab112 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.417029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405950-ea99-4b9b-b500-05a9d33ab112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.469653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ef405950-ea99-4b9b-b500-05a9d33ab112 None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:58.471116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef405950-ea99-4b9b-b500-05a9d33ab112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:58.479923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:58.483123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:58.540064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:58.648444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03c8b0-130e-4ecd-a19f-f6724f4b2dbd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:58.649233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 882/1789] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:58.650803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f6-8bb8-4890-b272-b3ecfe49f3a3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.653886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:58.654647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.654853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.655216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] PATH_INFO: `/v3/users/708cda0dbbb94d6ebda3768518539c15` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.656615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=708cda0dbbb94d6ebda3768518539c15)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:58.658836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f6-8bb8-4890-b272-b3ecfe49f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.659209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b32f6-8bb8-4890-b272-b3ecfe49f3a3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.659479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:58.660827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 883/1790] 10.222.0.62 () {54 vars in 961 bytes} [Mon Oct 17 17:44:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:44:58.670510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.670794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.671070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.704476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] MFA Rules not processed for user `a8a289b1980346cc89cd56154b8c32fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:58.705386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:58.723652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 884/1791] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Oct 17 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:58.724631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:58.734649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708cda0dbbb94d6ebda3768518539c15'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:58.734862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22712-3a2b-42c2-bb01-d37879f36e7f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:58.741496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:58.742348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:58.742577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:58.742850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:58.747523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708cda0dbbb94d6ebda3768518539c15'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:58.752706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:58.754510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:58.767158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 885/1792] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:44:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:44:58.772609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708cda0dbbb94d6ebda3768518539c15'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:58.773497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708cda0dbbb94d6ebda3768518539c15'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:58.783826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a0591674-af99-4027-bf58-d4d39a2d500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708cda0dbbb94d6ebda3768518539c15'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:58.796038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 908/1793] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:44:58 2022] DELETE /identity/v3/users/708cda0dbbb94d6ebda3768518539c15 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:59.056451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.068153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae197e-55c1-49c8-8dfd-68b647b7ebc4 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.141403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.142291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.142801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.143313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] PATH_INFO: `/v3/projects/cd24622c0af44ecc834b62750ff485c3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.144711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd24622c0af44ecc834b62750ff485c3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.146754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.148742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:59.212039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd24622c0af44ecc834b62750ff485c3', 'request_id': 'req-fb1db582-6071-42bc-b5a1-09a62407e001'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:59.221511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd24622c0af44ecc834b62750ff485c3', 'request_id': 'req-fb1db582-6071-42bc-b5a1-09a62407e001'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:59.227579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd24622c0af44ecc834b62750ff485c3', 'request_id': 'req-fb1db582-6071-42bc-b5a1-09a62407e001'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:59.238609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] The token cache is being invalidate because project cd24622c0af44ecc834b62750ff485c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:44:59.238892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:59.239533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fb1db582-6071-42bc-b5a1-09a62407e001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:44:59.241031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 886/1794] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:44:59 2022] DELETE /identity/v3/projects/cd24622c0af44ecc834b62750ff485c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:44:59.246628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.246921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.247197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.268406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:59.270459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:59.332483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 909/1795] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:44:59.339675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.339955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.340223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.360821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:59.362046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:59.370596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 887/1796] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:59.374975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.384908 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4c3ca-7b31-477e-918c-d4d015d7cd94 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.390184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.390789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.391065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.391331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.392007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:44:59.392307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.393971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.406611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 910/1797] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:44:59.411117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.420870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068480f1-0cab-4a24-b20d-0f54bfacd647 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.426621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.427251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.427526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.427792 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.428425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.430388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.461510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 888/1798] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:59.465728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.476025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a79f8-c605-425b-b00c-518b59cf831c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.506560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:44:59.537139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.537789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.538063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.538328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.538959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.540861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.564068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 911/1799] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:59.568345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.579364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0d5f-ad85-4b72-8a8d-b1fe184df137 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.584846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.585466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.585771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.586039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.586851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.588554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.599494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 889/1800] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:44:59.603836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.614639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ddaf-7e86-4a3c-9415-628838ce2efb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.621036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.622070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.622542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.623008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.623927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.626127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3507e-cbde-4f21-bf5b-798bcf7dfa0e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.640451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 912/1801] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:44:59.645599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.655994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd2e0-c4f4-4010-8b4f-39173dd5a8ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.660748 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.661398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.661700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.661970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] PATH_INFO: `/v3/projects/72271ba21329482992d2e0da25fc35b1/users/8c8208855e274b2788a6bf33f3694c51/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.677389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72271ba21329482992d2e0da25fc35b1, user_id=8c8208855e274b2788a6bf33f3694c51, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.680158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.695091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 890/1802] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:44:59 2022] PUT /identity/v3/projects/72271ba21329482992d2e0da25fc35b1/users/8c8208855e274b2788a6bf33f3694c51/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:44:59.705541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.705860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.706886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.739846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] MFA Rules not processed for user `8c8208855e274b2788a6bf33f3694c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:44:59.741091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:44:59.814652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 913/1803] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:44:59.819994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.891127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5db0e-1071-4303-a69b-399bba1b80a6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:44:59.896098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:44:59.896790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:44:59.897854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:44:59.899642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:44:59.900387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:44:59.902503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:44:59.938747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 891/1804] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:44:59.939954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:44:59.953073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86de11-b7eb-4aea-b7a6-bcaaba397f29 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.027657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.028285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.028562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.028832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.029468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.031512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.057846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 914/1805] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:44:59 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:00.059033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.075143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d843-98bc-4dca-bf87-389bc2474fb1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.094400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.095422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.095782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.095954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.096803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.098670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.109813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:00.116783 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 892/1806] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:00.121816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.133137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1ce7-b690-4abd-8b82-55c76f7308d7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.137812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.138477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.138761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.139629 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] PATH_INFO: `/v3/projects/44257597e045449e8bbc90c4f6cfa1ff/users/adf9894be9a2423dbfbce0a0f51a2ddc/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.156790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44257597e045449e8bbc90c4f6cfa1ff, user_id=adf9894be9a2423dbfbce0a0f51a2ddc, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.159660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.174582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 915/1807] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:00 2022] PUT /identity/v3/projects/44257597e045449e8bbc90c4f6cfa1ff/users/adf9894be9a2423dbfbce0a0f51a2ddc/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:00.179848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.191676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c309b8-7bf7-45d4-92c5-bed57d6e01f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.256639 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.257259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.257528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.257829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.258484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.260073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddaced-1048-47ca-a358-82a6284ce6ee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.273118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 893/1808] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:00.277895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.293794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838fe13-5a04-4adc-8daa-900e0008c69c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.300149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.300872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.301147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.301416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] PATH_INFO: `/v3/projects/44257597e045449e8bbc90c4f6cfa1ff/users/adf9894be9a2423dbfbce0a0f51a2ddc/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.306672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44257597e045449e8bbc90c4f6cfa1ff, user_id=adf9894be9a2423dbfbce0a0f51a2ddc, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.310198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.313124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:00.326415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 916/1809] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:00 2022] PUT /identity/v3/projects/44257597e045449e8bbc90c4f6cfa1ff/users/adf9894be9a2423dbfbce0a0f51a2ddc/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:00.337822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.338152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.338374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.380417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] MFA Rules not processed for user `adf9894be9a2423dbfbce0a0f51a2ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:00.381667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:00.450847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 894/1810] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:00.463227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.465029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:00.524912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa8af-8eee-4c47-a38f-a6d12f072c1f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.528832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.529423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.529730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.529998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.538869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.540292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.549938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 917/1811] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:00.639117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:00.650799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c808d1-857e-4c28-9ab1-be1d3d8af90d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:00.654844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:00.655466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:00.655745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:00.656018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:00.717411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:00.719148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86879c-3de4-46c9-8bed-543e7db2417c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:00.728459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 895/1812] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:01.400712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:01.402730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:01.540878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8250fa-b849-4a30-81bd-d03c79057fbe service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:01.548326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:01.549246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:01.549843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:01.550860 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] PATH_INFO: `/v3/users/60c71f557b8840c8901e59903ccef9fc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:01.552377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c71f557b8840c8901e59903ccef9fc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:01.554790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:01.631073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c71f557b8840c8901e59903ccef9fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:01.645519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c71f557b8840c8901e59903ccef9fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:01.667418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c71f557b8840c8901e59903ccef9fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:01.668214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c71f557b8840c8901e59903ccef9fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:01.677060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c71f557b8840c8901e59903ccef9fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:01.684808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 918/1813] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:01 2022] DELETE /identity/v3/users/60c71f557b8840c8901e59903ccef9fc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:01.689180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:01.689730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:01.689730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:01.711898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:01.713704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:01.748222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:01.829933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 896/1814] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:01.838820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:01.840263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:01.863974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:01.936529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51a9e-af9b-4019-b311-38273f36132f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:01.943536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:01.944320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:01.944595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:01.944934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:01.961064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:01.970770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea88f6e-f676-4728-86a8-465e64364cad service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:01.982713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 919/1815] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:02.537565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:02.539034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:02.567001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2fbf-9cb1-4337-b6a3-41406daa87bd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:02.573835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:02.574018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:02.574295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:02.574567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] PATH_INFO: `/v3/projects/068a46a3f6e745fe81b112db925754a6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:02.575708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] RBAC: Authorizing `identity:delete_project(project_id=068a46a3f6e745fe81b112db925754a6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:02.578042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:02.648996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068a46a3f6e745fe81b112db925754a6', 'request_id': 'req-6b8cfea1-0473-4928-bed5-ede4ef4a037a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:02.660230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068a46a3f6e745fe81b112db925754a6', 'request_id': 'req-6b8cfea1-0473-4928-bed5-ede4ef4a037a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:02.666520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068a46a3f6e745fe81b112db925754a6', 'request_id': 'req-6b8cfea1-0473-4928-bed5-ede4ef4a037a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:02.678386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] The token cache is being invalidate because project 068a46a3f6e745fe81b112db925754a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:02.678681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:02.679345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:02.680862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 897/1816] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:02 2022] DELETE /identity/v3/projects/068a46a3f6e745fe81b112db925754a6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:03.805099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17ae8-952d-417c-83ff-1f67d387a90c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:03.806351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17ae8-952d-417c-83ff-1f67d387a90c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:03.806676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17ae8-952d-417c-83ff-1f67d387a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:03.831020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bad17ae8-952d-417c-83ff-1f67d387a90c None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:03.832370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bad17ae8-952d-417c-83ff-1f67d387a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:03.894650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 920/1817] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:45:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:03.915902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:03.918170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:03.993027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfea1-0473-4928-bed5-ede4ef4a037a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:03.999049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:04.000073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:04.000387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:04.000752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:04.011267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:04.012944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:04.026267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 898/1818] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:45:04.609363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041603d2-fd06-4e02-a868-cbe5e55ce4af None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:04.609708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041603d2-fd06-4e02-a868-cbe5e55ce4af None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:04.609986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041603d2-fd06-4e02-a868-cbe5e55ce4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:04.631463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-041603d2-fd06-4e02-a868-cbe5e55ce4af None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:04.632661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-041603d2-fd06-4e02-a868-cbe5e55ce4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:04.640470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 921/1819] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:04.653267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:04.664419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5577c-d207-4a19-b7a2-979aa81d44e9 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:04.669991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:04.670597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:04.670877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:04.671151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:04.680093 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:04.681722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:04.689859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 899/1820] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:45:04.939831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add6d2-f7f6-45ca-87b8-7d89e3be1a42 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:04.940296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add6d2-f7f6-45ca-87b8-7d89e3be1a42 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:04.940469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add6d2-f7f6-45ca-87b8-7d89e3be1a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:04.960653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e0add6d2-f7f6-45ca-87b8-7d89e3be1a42 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:04.961887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e0add6d2-f7f6-45ca-87b8-7d89e3be1a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:04.970047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 922/1821] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:04.982522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:04.994454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1430-3943-43bd-b3aa-d434bd68faf1 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:05.002164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:05.002837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:05.003212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:05.003484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:05.013333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:05.014976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:05.025475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 900/1822] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:45:05.461196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a035-ee7a-49bc-83df-23809989036e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:05.461482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a035-ee7a-49bc-83df-23809989036e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:05.461796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a035-ee7a-49bc-83df-23809989036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:05.485795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1833a035-ee7a-49bc-83df-23809989036e None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:05.487590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1833a035-ee7a-49bc-83df-23809989036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:05.512288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 923/1823] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:05.525700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:05.537308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ec9d4-d566-4fd1-828d-d543c9fea2af service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:05.542588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:05.543398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:05.543682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:05.544036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:05.549408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:05.555162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:05.557022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b3c3-068c-4a02-8ca8-9d7109a2141b service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:05.566878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 901/1824] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:45:07.776353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a035-ee7a-49bc-83df-23809989036e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:07.778709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1833a035-ee7a-49bc-83df-23809989036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:07.871005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a035-ee7a-49bc-83df-23809989036e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:07.877232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:07.877232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:07.877232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:07.877232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] PATH_INFO: `/v3/users/8eb931a91ec64baa8e6a35f2295eb005` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:07.877998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb931a91ec64baa8e6a35f2295eb005)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:07.880501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:07.940048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:07.943529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb931a91ec64baa8e6a35f2295eb005'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:07.954484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb931a91ec64baa8e6a35f2295eb005'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:07.970312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb931a91ec64baa8e6a35f2295eb005'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:07.971048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb931a91ec64baa8e6a35f2295eb005'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:07.980299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb931a91ec64baa8e6a35f2295eb005'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:07.986809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 924/1825] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:07 2022] DELETE /identity/v3/users/8eb931a91ec64baa8e6a35f2295eb005 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:07.992169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:07.992754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:07.992754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.018525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:08.020115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:08.092100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 902/1826] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:08.104714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.106354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:08.187809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456a5-4e05-4ee7-8517-72967acae5e7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.193484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.194199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.194481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.194753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.204999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.207332 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caae1b4-02a5-4505-874f-4c13d0043ba6 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.218878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 925/1827] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:08.436534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.438301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:08.461435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696908d-48fe-4bc7-a4f5-0e72ac6d4e20 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.467798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.468461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.468704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.469014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] PATH_INFO: `/v3/projects/2bd7cfeb233d4f9d870f6cfbc4107edf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.470345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd7cfeb233d4f9d870f6cfbc4107edf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.472530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.522477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd7cfeb233d4f9d870f6cfbc4107edf', 'request_id': 'req-548dced9-ae9e-4a13-88d0-eb45fee11c34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:08.531079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd7cfeb233d4f9d870f6cfbc4107edf', 'request_id': 'req-548dced9-ae9e-4a13-88d0-eb45fee11c34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:08.537057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd7cfeb233d4f9d870f6cfbc4107edf', 'request_id': 'req-548dced9-ae9e-4a13-88d0-eb45fee11c34'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:08.548180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] The token cache is being invalidate because project 2bd7cfeb233d4f9d870f6cfbc4107edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:08.548471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:08.549100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-548dced9-ae9e-4a13-88d0-eb45fee11c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:08.550693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 903/1828] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:08 2022] DELETE /identity/v3/projects/2bd7cfeb233d4f9d870f6cfbc4107edf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:08.556096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.556656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.556937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.578632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:08.580019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:08.652263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 926/1829] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:08.659831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.660202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.660486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.681377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:08.682615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:08.691228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 904/1830] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:08.695718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.705265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec66fc7-f775-4445-9f2c-522fd1d81e62 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.709954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.710559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.710838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.711112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.711786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:08.713297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.713750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.727301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 927/1831] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:08.733065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.742999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1921e-3f2f-42d0-894e-33e689c4e625 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.748852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.749597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.749882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.750152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.751155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.753166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.783779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 905/1832] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:08 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:08.788152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.801630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540eba-c0d9-48f0-b135-750ee08c3e1c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.867197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:08.878748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.879571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.879864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.880446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.881102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.883108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.911625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 928/1833] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:08 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:08.912270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.925463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083797-538c-4bc5-981c-51247252392b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.930781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.931395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.931676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.931938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.932658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.934318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.948029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 906/1834] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:08.952096 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:08.964080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dfd14-4037-4768-8be8-3d0bb36abc03 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:08.969063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:08.969718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:08.970001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:08.970272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:08.970918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:08.972636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3869f-ed40-45c7-b269-333e215af675 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:08.984541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 929/1835] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:08.989285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:09.000630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcd4b-ddd8-4d02-b7b0-32544a10e272 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:09.005569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:09.006299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:09.006590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:09.006878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] PATH_INFO: `/v3/projects/9c9fb110091d49c6ac675fdc43a89d50/users/2d4ed1ec4adb4570af0e4ca93d0f0246/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:09.023164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9fb110091d49c6ac675fdc43a89d50, user_id=2d4ed1ec4adb4570af0e4ca93d0f0246, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:09.025995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:09.042136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 907/1836] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:08 2022] PUT /identity/v3/projects/9c9fb110091d49c6ac675fdc43a89d50/users/2d4ed1ec4adb4570af0e4ca93d0f0246/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:09.069932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:09.070177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:09.070463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:09.109017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] MFA Rules not processed for user `2d4ed1ec4adb4570af0e4ca93d0f0246`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:09.110256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:09.181049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 930/1837] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:09.192942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:09.194675 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:09.213028 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:09.261202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc450ea-3089-4007-af9e-405a32ea42e6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:09.264876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:09.265492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:09.265802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:09.266072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:09.281609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:09.281609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f999f6-c3ba-4f4a-90e1-1ef2a9e90f4f service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:09.291036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 908/1838] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:14.587271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:14.656125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36266a18-05cb-472b-86e8-714b307688a0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:14.663284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:14.663939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:14.664219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:14.664490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] PATH_INFO: `/v3/users/2d4ed1ec4adb4570af0e4ca93d0f0246` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:14.665766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4ed1ec4adb4570af0e4ca93d0f0246)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:14.667706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:14.722119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4ed1ec4adb4570af0e4ca93d0f0246'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:14.730699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4ed1ec4adb4570af0e4ca93d0f0246'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:14.738464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:14.745322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4ed1ec4adb4570af0e4ca93d0f0246'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:14.746262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4ed1ec4adb4570af0e4ca93d0f0246'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:14.753721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4ed1ec4adb4570af0e4ca93d0f0246'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:14.760264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 931/1839] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:14 2022] DELETE /identity/v3/users/2d4ed1ec4adb4570af0e4ca93d0f0246 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:14.764928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:14.765402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:14.765502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:14.788013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:14.789239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:14.854245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 909/1840] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:14.864193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:14.865655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:14.932974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a568e-2dfe-4ffa-855d-d4114c13110b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:14.936856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:14.937612 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:14.937984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:14.938226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:14.947724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:14.949158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8216d-d2e0-4afe-a4e8-3ff27ea17b50 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:14.959223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 932/1841] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:15.329060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:15.330572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:15.343590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c0954-e5df-44bb-91da-e1d3b872760b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:15.348869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:15.349785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:15.350257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:15.350702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] PATH_INFO: `/v3/projects/9c9fb110091d49c6ac675fdc43a89d50` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:15.352054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9fb110091d49c6ac675fdc43a89d50)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:15.354364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:15.406360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9fb110091d49c6ac675fdc43a89d50', 'request_id': 'req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:15.415082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9fb110091d49c6ac675fdc43a89d50', 'request_id': 'req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:15.421653 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9fb110091d49c6ac675fdc43a89d50', 'request_id': 'req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:15.433079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] The token cache is being invalidate because project 9c9fb110091d49c6ac675fdc43a89d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:15.433365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:15.434079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:15.437672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 910/1842] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:15 2022] DELETE /identity/v3/projects/9c9fb110091d49c6ac675fdc43a89d50 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:17.519592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18cf3a-e609-4f68-a385-b3c0de711eb9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:17.520203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18cf3a-e609-4f68-a385-b3c0de711eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:17.520203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18cf3a-e609-4f68-a385-b3c0de711eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:17.540097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9e18cf3a-e609-4f68-a385-b3c0de711eb9 None None] MFA Rules not processed for user `5fa576bcd66d4c82b20dfc005eb08a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:17.541308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9e18cf3a-e609-4f68-a385-b3c0de711eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:17.602240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 933/1843] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:21.780889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:21.782478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:21.846394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:21.885353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3f3a-e3aa-47b6-b81e-240172ef6cfb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:21.891036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:21.891866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:21.892368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:21.892693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] PATH_INFO: `/v3/users/95a26ae6de8646cb99f3c372413f853e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:21.894118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a26ae6de8646cb99f3c372413f853e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:21.896636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:21.946991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a26ae6de8646cb99f3c372413f853e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:21.947808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a26ae6de8646cb99f3c372413f853e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:21.956733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a26ae6de8646cb99f3c372413f853e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:21.970091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a26ae6de8646cb99f3c372413f853e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:21.977343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a26ae6de8646cb99f3c372413f853e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:21.983618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 911/1844] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:21 2022] DELETE /identity/v3/users/95a26ae6de8646cb99f3c372413f853e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:21.987920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:21.988485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:21.988485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.008039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:22.009246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:22.070437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 934/1845] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:22.080383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.082064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:22.146442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d98e8d-4e2d-41d6-94eb-06b6df6c1a21 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.150210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.150823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.151228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.151498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.161611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.163101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91315020-821b-4244-ab6f-a8588a452034 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:22.174694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 912/1846] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:22.472841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.474456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:22.506261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159b360-d1fd-468e-99e1-5357c19fa4cb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.513816 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.514575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.514920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.515262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] PATH_INFO: `/v3/projects/e3bd3adf1023489da16f9d8cf71fe19a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.516756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bd3adf1023489da16f9d8cf71fe19a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.518886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:22.548593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:22.575632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bd3adf1023489da16f9d8cf71fe19a', 'request_id': 'req-e25976a1-4ff2-4810-ab93-eda27cb6f13b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:22.585822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bd3adf1023489da16f9d8cf71fe19a', 'request_id': 'req-e25976a1-4ff2-4810-ab93-eda27cb6f13b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:22.593201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bd3adf1023489da16f9d8cf71fe19a', 'request_id': 'req-e25976a1-4ff2-4810-ab93-eda27cb6f13b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:22.605753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] The token cache is being invalidate because project e3bd3adf1023489da16f9d8cf71fe19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:22.606049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:22.606842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e25976a1-4ff2-4810-ab93-eda27cb6f13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:22.608439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 935/1847] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:22 2022] DELETE /identity/v3/projects/e3bd3adf1023489da16f9d8cf71fe19a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:22.613688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.613984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.614259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.635820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:22.637042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:22.701735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 913/1848] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:22.710975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.711396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.711742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.733738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:22.735038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:22.743775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 936/1849] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:22.748169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.753045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:22.759008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e397-e6b9-47f7-b7ac-c50e971fb948 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.764857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.765548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.766101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.766593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.767485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:22.767859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.770033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:22.783034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 914/1850] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:22.787565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.802693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be16de4-a731-4658-8bfc-d4f6a2c16ec5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.811191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.811823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.812099 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.812372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.813051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.814977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:22.861289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.865990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 937/1851] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:22 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:22.872398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92695-59be-4e88-8818-b42cb927de1f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.936217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.936838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.937117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.937390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.938247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.940392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:22.965829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 915/1852] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:22 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:22.969533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:22.980158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759a50-00d7-489d-b2c5-7307f30005e0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:22.984774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:22.985374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:22.985677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:22.985946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:22.986594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:22.990896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:23.003354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 938/1853] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:23.007459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:23.018729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3582-3175-4dd1-b8bf-bb8d85baf78b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:23.023952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:23.025188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:23.025429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:23.025733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:23.026908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:23.028057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb929ee-1da3-49e5-96fd-ed479b7ad9d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:23.041670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 916/1854] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:23.044747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:23.059813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bab91-7c78-4334-b5ed-093c550af54b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:23.065119 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:23.065819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:23.066089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:23.066392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] PATH_INFO: `/v3/projects/926ca4027b4b4406bcfdc0efd8665946/users/af9853c7fd7a493eb8fdd538a7f13b82/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:23.081512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926ca4027b4b4406bcfdc0efd8665946, user_id=af9853c7fd7a493eb8fdd538a7f13b82, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:23.084349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:23.098426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 939/1855] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:23 2022] PUT /identity/v3/projects/926ca4027b4b4406bcfdc0efd8665946/users/af9853c7fd7a493eb8fdd538a7f13b82/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:23.108918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:23.109330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:23.109693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:23.139235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] MFA Rules not processed for user `af9853c7fd7a493eb8fdd538a7f13b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:23.140735 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:23.213492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 917/1856] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:23.224765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:23.226871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:23.295810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad787f45-7ff3-4a5f-b576-f30be3a2bc05 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:23.300504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:23.301301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:23.301706 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:23.302153 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:23.312745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:23.314107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce8c6-0b37-4bd5-a805-173d3df1eb77 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:23.333751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 940/1857] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:31.284625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:31.286214 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:31.372045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:31.382855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fb65a-acc7-45df-86c9-03ed8050a0b6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:31.411683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:31.412586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:31.412943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:31.413348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] PATH_INFO: `/v3/users/8c8208855e274b2788a6bf33f3694c51` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:31.419152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8208855e274b2788a6bf33f3694c51)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:31.421315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:31.480847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8208855e274b2788a6bf33f3694c51'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:31.481876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8208855e274b2788a6bf33f3694c51'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:31.490409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8208855e274b2788a6bf33f3694c51'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:31.505246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8208855e274b2788a6bf33f3694c51'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:31.512247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8208855e274b2788a6bf33f3694c51'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:31.518289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 918/1858] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:31 2022] DELETE /identity/v3/users/8c8208855e274b2788a6bf33f3694c51 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:31.523697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:31.524214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:31.524311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:31.544051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:31.545250 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:31.589376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:31.606577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 941/1859] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:31.616416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:31.618434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:31.680987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee69df-bc36-46ec-9581-2fac8b12baee admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:31.685142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:31.685824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:31.686103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:31.686373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:31.697493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:31.699001 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:31.710568 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 919/1860] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:32.041460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:32.043126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:32.057819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e7345-6967-43da-b840-af2ebeb4ad10 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:32.064001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:32.064779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:32.065143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:32.065538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] PATH_INFO: `/v3/projects/72271ba21329482992d2e0da25fc35b1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:32.067061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72271ba21329482992d2e0da25fc35b1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:32.069224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:32.122446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72271ba21329482992d2e0da25fc35b1', 'request_id': 'req-3db43c05-eb42-44b4-acb6-1816013cc7e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.132118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72271ba21329482992d2e0da25fc35b1', 'request_id': 'req-3db43c05-eb42-44b4-acb6-1816013cc7e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.138653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72271ba21329482992d2e0da25fc35b1', 'request_id': 'req-3db43c05-eb42-44b4-acb6-1816013cc7e9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.152831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] The token cache is being invalidate because project 72271ba21329482992d2e0da25fc35b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:32.153130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.154155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.155905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 942/1861] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:32 2022] DELETE /identity/v3/projects/72271ba21329482992d2e0da25fc35b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:32.160225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:32.170451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee4e2-f5b6-4e79-8288-ebd6b9f54f55 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:32.231094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:32.231636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:32.232143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:32.232264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] PATH_INFO: `/v3/users/adf9894be9a2423dbfbce0a0f51a2ddc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:32.233344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf9894be9a2423dbfbce0a0f51a2ddc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:32.235442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:32.259993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:32.286202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf9894be9a2423dbfbce0a0f51a2ddc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.286843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf9894be9a2423dbfbce0a0f51a2ddc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.294248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf9894be9a2423dbfbce0a0f51a2ddc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.306314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf9894be9a2423dbfbce0a0f51a2ddc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.312973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ac21b514-f394-4ef6-a018-cd7e7dffb132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf9894be9a2423dbfbce0a0f51a2ddc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.319198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 920/1862] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:32 2022] DELETE /identity/v3/users/adf9894be9a2423dbfbce0a0f51a2ddc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:32.696824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:32.699411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:32.724439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43c05-eb42-44b4-acb6-1816013cc7e9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:32.791120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:32.791765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:32.792040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:32.792309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] PATH_INFO: `/v3/projects/44257597e045449e8bbc90c4f6cfa1ff` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:32.793429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44257597e045449e8bbc90c4f6cfa1ff)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:32.795374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:32.843060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44257597e045449e8bbc90c4f6cfa1ff', 'request_id': 'req-01b75f49-1d39-46e9-8521-d5c234d2bf68'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.850833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44257597e045449e8bbc90c4f6cfa1ff', 'request_id': 'req-01b75f49-1d39-46e9-8521-d5c234d2bf68'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.856590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44257597e045449e8bbc90c4f6cfa1ff', 'request_id': 'req-01b75f49-1d39-46e9-8521-d5c234d2bf68'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.869978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] The token cache is being invalidate because project 44257597e045449e8bbc90c4f6cfa1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:32.870325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.871224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-01b75f49-1d39-46e9-8521-d5c234d2bf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:32.873603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 943/1863] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:32 2022] DELETE /identity/v3/projects/44257597e045449e8bbc90c4f6cfa1ff => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:32.878772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:32.879169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:32.879561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:32.900364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:32.901806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:32.974670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 921/1864] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:32.983186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:32.983186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:32.983478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:32.996525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:33.011374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:33.012969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:33.023008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 944/1865] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:33.027221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.037909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9df5bf-357f-4616-9b70-f0e518cdd191 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.042642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.043310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.043592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.043863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.044504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:33.044804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.046454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.060413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 922/1866] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:33.064752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.074714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31353-c70b-4b64-9181-72062b86c6d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.079781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.080399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.080671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.080943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.082314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.083794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.112405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 945/1867] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:33.116832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.127860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08a14-1059-42c3-a7cf-cd70ae2a9406 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.188117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.188658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.188912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.189179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.189862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.191934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.215779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 923/1868] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:33.221437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.232290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767395b-d11e-47c2-a3f7-e75b8712dda0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.238340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.238960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.239343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.239497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.240237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.241745 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.253627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 946/1869] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:33.258034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.268753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d8c58-5834-430c-9753-4e8673c9775c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.274147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.274882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.275290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.275665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.276413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.278560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286683-5d13-4c9b-accf-7941b26c2170 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.294884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 924/1870] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:33.295491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.307359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb845-4d8c-4e06-b567-8ea3b575a9a6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.312617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.313648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.313906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.314182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] PATH_INFO: `/v3/projects/78f4288a7e9247018f49f336a1073e94/users/c9e114889b3d49f2abf2abcabac5c13d/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.331399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f4288a7e9247018f49f336a1073e94, user_id=c9e114889b3d49f2abf2abcabac5c13d, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.334763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.351849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 947/1871] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:33 2022] PUT /identity/v3/projects/78f4288a7e9247018f49f336a1073e94/users/c9e114889b3d49f2abf2abcabac5c13d/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:33.362387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.362676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.363068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.371824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:33.394762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] MFA Rules not processed for user `c9e114889b3d49f2abf2abcabac5c13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:33.396161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:33.471575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 925/1872] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:33.477065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.541693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429a40-e2c5-40fe-ac17-f6c7479b198f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.546419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.547028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.547306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.547577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.548192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.550130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.579419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 948/1873] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:33.584278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.596096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddeab7-b19f-4a4d-8cfc-9d732e6fa871 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.657667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.658374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.658539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.658806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.659578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.661828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.689904 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 926/1874] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:33.694273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.706837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf221-a7e8-4e0c-adf2-5069ff2fb3dc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.713671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.714378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.714661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.714934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.715572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.717214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.731054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 949/1875] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:33.733514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.746537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700f38-e211-4eb0-a042-5fabbe7a9736 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.752248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.753070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.753347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.753872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] PATH_INFO: `/v3/projects/738e5fda79cc40378b396f669c530291/users/8f67409d9d974d6c95ce1d85e35a94b5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.774802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738e5fda79cc40378b396f669c530291, user_id=8f67409d9d974d6c95ce1d85e35a94b5, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.778365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.799645 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 927/1876] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:33 2022] PUT /identity/v3/projects/738e5fda79cc40378b396f669c530291/users/8f67409d9d974d6c95ce1d85e35a94b5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:33.803556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.815670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799b59-3ba0-4dbc-a5fa-4d9b20b2c3b4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.896028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.896654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.897019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.897297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.898037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.900213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fff2f-50d6-48d7-9266-ebef76d61553 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.911463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 950/1877] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:45:33.915255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:33.929118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f447f-c7cd-4777-b36c-e8899b4b6f78 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:33.935672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:33.936155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.936490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.936818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] PATH_INFO: `/v3/projects/738e5fda79cc40378b396f669c530291/users/8f67409d9d974d6c95ce1d85e35a94b5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:33.939139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738e5fda79cc40378b396f669c530291, user_id=8f67409d9d974d6c95ce1d85e35a94b5, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:33.942225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:33.954200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 928/1878] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:33 2022] PUT /identity/v3/projects/738e5fda79cc40378b396f669c530291/users/8f67409d9d974d6c95ce1d85e35a94b5/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:33.969726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:33.969726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:33.969726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:34.000534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:34.010126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] MFA Rules not processed for user `8f67409d9d974d6c95ce1d85e35a94b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:34.011556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:34.095485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 951/1879] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:34.107681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:34.109607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:34.165975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:34.172531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cf5a-f7ea-4ea2-a8bd-f7f2aca2b130 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:34.176540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:34.177160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:34.177814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:34.178087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:34.188264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:34.189726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:34.199478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 929/1880] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:34.280755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:34.290479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0ca0-214f-4d77-af5c-dc913548fd8e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:34.294166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:34.294762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:34.295032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:34.295300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:34.354592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:34.356083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253ba3-f6b3-4eb1-8bec-e9212caf4dae service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:34.365381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 952/1881] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:35.144711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:35.146211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:35.216060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa62af-f51a-4682-bd25-3a94a0fadc48 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:35.220571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:35.221203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:35.221478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:35.221782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] PATH_INFO: `/v3/users/af9853c7fd7a493eb8fdd538a7f13b82` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:35.223046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9853c7fd7a493eb8fdd538a7f13b82)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:35.224978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:35.275662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9853c7fd7a493eb8fdd538a7f13b82'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.276236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9853c7fd7a493eb8fdd538a7f13b82'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.287007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9853c7fd7a493eb8fdd538a7f13b82'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.304421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9853c7fd7a493eb8fdd538a7f13b82'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.311464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9853c7fd7a493eb8fdd538a7f13b82'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.317513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 930/1882] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:35 2022] DELETE /identity/v3/users/af9853c7fd7a493eb8fdd538a7f13b82 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:35.322247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:35.322754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:35.322845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:35.342987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:35.344237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:35.406710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 953/1883] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:35.417190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:35.418683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:35.484758 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807086b-193f-4b72-a85e-8042157f31fb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:35.489021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:35.489661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:35.489935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:35.490203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:35.500202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:35.501654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3513-1a94-45dd-9560-3fa7b377ee6d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:35.511768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 931/1884] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:45:35.789914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:35.791384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:35.830385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf221d-ed89-4851-ab1f-311738d52111 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:35.837021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:35.837701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:35.837979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:35.838252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] PATH_INFO: `/v3/projects/926ca4027b4b4406bcfdc0efd8665946` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:35.839412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] RBAC: Authorizing `identity:delete_project(project_id=926ca4027b4b4406bcfdc0efd8665946)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:35.841341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:35.881928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:35.900077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926ca4027b4b4406bcfdc0efd8665946', 'request_id': 'req-619197cc-2d72-4506-bc25-9a83b1cb962b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.909291 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926ca4027b4b4406bcfdc0efd8665946', 'request_id': 'req-619197cc-2d72-4506-bc25-9a83b1cb962b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.915940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926ca4027b4b4406bcfdc0efd8665946', 'request_id': 'req-619197cc-2d72-4506-bc25-9a83b1cb962b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.934101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] The token cache is being invalidate because project 926ca4027b4b4406bcfdc0efd8665946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:35.934390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.935100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-619197cc-2d72-4506-bc25-9a83b1cb962b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:35.936602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 954/1885] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:35 2022] DELETE /identity/v3/projects/926ca4027b4b4406bcfdc0efd8665946 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:35.941960 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:35.942299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:35.942572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:35.963173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:35.964454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:35.969786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:36.030369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 932/1886] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:36.041905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c04c5-075a-4ceb-aaf2-0af8ca462335 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.042191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c04c5-075a-4ceb-aaf2-0af8ca462335 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.042466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c04c5-075a-4ceb-aaf2-0af8ca462335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.064144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-793c04c5-075a-4ceb-aaf2-0af8ca462335 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:36.065374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-793c04c5-075a-4ceb-aaf2-0af8ca462335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:36.074555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 955/1887] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:36.079318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.091521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d2ef-e0d9-4868-b4e9-ea0e1c161152 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.097447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.098188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.098423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.098623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.099267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:36.099569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.101165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.103755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.104596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.104596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.125974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 933/1888] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:36.126169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:36.126440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:36.126969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.138771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5704a-25f0-47a0-bf0e-8bc07fbfd9ce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.143869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.144806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.145390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.145390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.146015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.148082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.179298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 934/1889] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:36.183134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.199931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 956/1890] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:36.224653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.227128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:36.267175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897906a-c7ab-48db-85ac-a9d40f44af4e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.272292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.272987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.273417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.273802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.278159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.281008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.309510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 935/1891] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:36.313369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.324416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d766a0a-df7f-4976-91e1-0d6435750e8e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.330505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.331287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.331608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75ae38-7c11-4acf-86b1-f964568f482a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.332134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.332134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.333493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.335437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.349179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 936/1892] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:45:36.350390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.360824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f518a3e-8e49-478b-b04d-564a18fc0a12 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.368178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.368793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.369070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.369359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.370024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.372048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.387661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 937/1893] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:45:36.388738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.398665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3a17e-1db2-40be-b865-c7941fa27a68 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.403577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.404228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.404501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.404767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] PATH_INFO: `/v3/projects/21d6843d68034c1d8b6a902fc25b4a6f/users/e784022a428844f184002fdfc8877d9a/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.408424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:36.417567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.418222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.418861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.419246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.420058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d6843d68034c1d8b6a902fc25b4a6f, user_id=e784022a428844f184002fdfc8877d9a, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.422795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa1aa-4024-4c68-90c5-3ed7cc3ea02a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.438578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 938/1894] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:36 2022] PUT /identity/v3/projects/21d6843d68034c1d8b6a902fc25b4a6f/users/e784022a428844f184002fdfc8877d9a/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:36.454897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.454897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.454897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.481226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] MFA Rules not processed for user `e784022a428844f184002fdfc8877d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:36.482437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:36.483054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.484926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.491220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:36.495921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 957/1895] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 17:45:36.561626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 939/1896] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:36.566064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.578798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e2e3-de6f-4c1b-8481-9b9cb561c144 service swift] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.640906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.641647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.641819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.642273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.643015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.645242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.680290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 958/1897] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:36.682082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.698172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679422-eab0-43f2-9b1c-656d8fc0d00d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.775723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.776460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.776802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.777143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.777924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.780296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.805636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 940/1898] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:36.807975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.819408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2506730-5e5b-4a9e-8795-afe58109432f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.824828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.825493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.825815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.826090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.826742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.828337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.844914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 959/1899] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:36.846219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.857010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bf1f-d64e-4963-aec3-0943537dc1db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.862042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.862659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.862962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.863234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.864019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.865666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94754bf-02df-4474-8ffe-a5e62f6a6219 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.881477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 941/1900] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:36.882999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:36.896867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581504d9-b0d0-4047-8ce4-9f77d0282be7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:36.901786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:36.902459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.902739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.903089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] PATH_INFO: `/v3/projects/6a9b67b06e2a43789cde775c7270aa96/users/e5347f0efbf749acbcd8cc409b5dc78c/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:36.920216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9b67b06e2a43789cde775c7270aa96, user_id=e5347f0efbf749acbcd8cc409b5dc78c, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:36.922935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:36.954846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 960/1901] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:36 2022] PUT /identity/v3/projects/6a9b67b06e2a43789cde775c7270aa96/users/e5347f0efbf749acbcd8cc409b5dc78c/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:36.964267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:36.964551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:36.964829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.003546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] MFA Rules not processed for user `e5347f0efbf749acbcd8cc409b5dc78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:37.005471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:37.097766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 942/1902] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:37.100664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.177551 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:37.193893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076a10-09f7-4ab3-877e-f6357ebfb3fd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.202499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.203831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.204216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.204602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.205414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.207876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.272877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 961/1903] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:37 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:37.274486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.289327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c74c-ae74-49e3-b130-1459bb49d346 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.329483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:37.390298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.391034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.391379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.391740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.392430 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.394566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.459024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 943/1904] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:37 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:37.464802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.499877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c7d46-9d70-4b53-9831-885ee07691b8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.509347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.510585 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.511312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.512003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.513434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.517615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.537030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 962/1905] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:37.538434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.552703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1fe26-ae1e-44b7-82d6-2558e5f580ea admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.560950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.561788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.562252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.562394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] PATH_INFO: `/v3/projects/4cdbe50730034b61b37cf26478a885ae/users/8f974cf10be34bfc8726185fc484a4c3/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.585991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdbe50730034b61b37cf26478a885ae, user_id=8f974cf10be34bfc8726185fc484a4c3, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.589978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.612549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 944/1906] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:37 2022] PUT /identity/v3/projects/4cdbe50730034b61b37cf26478a885ae/users/8f974cf10be34bfc8726185fc484a4c3/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:37.615827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.628215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ea33-3bd6-4a6d-af53-2311e0c3c459 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.704450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.705304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.705674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.706011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.707441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.709471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec4968-cd03-43dc-a6e0-75f485708072 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.723166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 963/1907] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:37.727129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:37.743524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0198e2-f3b0-48d5-a91c-60cc34450376 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:37.749397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:37.750905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.751193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.751473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] PATH_INFO: `/v3/projects/4cdbe50730034b61b37cf26478a885ae/users/8f974cf10be34bfc8726185fc484a4c3/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.753559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdbe50730034b61b37cf26478a885ae, user_id=8f974cf10be34bfc8726185fc484a4c3, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:37.756507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:37.772951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 945/1908] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:37 2022] PUT /identity/v3/projects/4cdbe50730034b61b37cf26478a885ae/users/8f974cf10be34bfc8726185fc484a4c3/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:37.871365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:37.872253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:37.872688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:37.971216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] MFA Rules not processed for user `8f974cf10be34bfc8726185fc484a4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:37.972529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:38.057529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 964/1909] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:38.070546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:38.072500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:38.149900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c58e-53d6-4527-9b46-68cf41babe44 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:38.153401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:38.154109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:38.154392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:38.154684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:38.229388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:38.231511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:38.243951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 946/1910] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:40.004959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:40.006450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:40.039461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc7fc-5aac-43db-a2a8-1298313ac05b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:40.043192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:40.044154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:40.044503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:40.044850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:40.139228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:40.164592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:40.166083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:40.194885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 965/1911] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:40.901334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:40.916058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b24b-a12b-4be1-ae02-5ea65e7ac0bb service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:40.921815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:40.922612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:40.923044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:40.923580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:40.940822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:40.943629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5956-df0b-4e92-bc76-b2ff883982e6 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:40.960874 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 947/1912] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:41.691289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:41.693608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:41.783287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5c53d-bb62-4951-b7c4-251539c69e45 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:41.792308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:41.793140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:41.793521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:41.793922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] PATH_INFO: `/v3/users/c9e114889b3d49f2abf2abcabac5c13d` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:41.795341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e114889b3d49f2abf2abcabac5c13d)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:41.797833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:41.863404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e114889b3d49f2abf2abcabac5c13d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:41.886016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e114889b3d49f2abf2abcabac5c13d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:41.902530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e114889b3d49f2abf2abcabac5c13d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:41.903280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e114889b3d49f2abf2abcabac5c13d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:41.914520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e114889b3d49f2abf2abcabac5c13d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:41.928968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:41.929539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:41.929871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:41.933367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 966/1913] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:41 2022] DELETE /identity/v3/users/c9e114889b3d49f2abf2abcabac5c13d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:41.955842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:41.957509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:41.963971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:42.039802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 948/1914] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:42.047739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:42.047739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:42.135278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb19d7c-dfcd-4b3b-8c71-ad790f5962d4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:42.139673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:42.140929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:42.141379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:42.141717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:42.154748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:42.156289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:42.168001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 967/1915] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:42.639011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:42.642365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:42.677251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f31210-2cf3-4824-abc3-a587ffd20137 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:42.683595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:42.684401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:42.684745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:42.685541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] PATH_INFO: `/v3/projects/78f4288a7e9247018f49f336a1073e94` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:42.686724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f4288a7e9247018f49f336a1073e94)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:42.689099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:42.751425 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f4288a7e9247018f49f336a1073e94', 'request_id': 'req-7a93cb48-4f54-43ce-a164-73d05ac5e316'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.767581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f4288a7e9247018f49f336a1073e94', 'request_id': 'req-7a93cb48-4f54-43ce-a164-73d05ac5e316'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.778020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f4288a7e9247018f49f336a1073e94', 'request_id': 'req-7a93cb48-4f54-43ce-a164-73d05ac5e316'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.792829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] The token cache is being invalidate because project 78f4288a7e9247018f49f336a1073e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:42.793145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.794077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.796688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 949/1916] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:42 2022] DELETE /identity/v3/projects/78f4288a7e9247018f49f336a1073e94 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:42.800799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:42.813361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8a4f-45fc-46c8-878d-06cc0c6ac5e9 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:42.836730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:42.912838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:42.913450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:42.913881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:42.914157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] PATH_INFO: `/v3/users/8f67409d9d974d6c95ce1d85e35a94b5` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:42.916351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f67409d9d974d6c95ce1d85e35a94b5)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:42.918401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:42.973658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f67409d9d974d6c95ce1d85e35a94b5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.982274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f67409d9d974d6c95ce1d85e35a94b5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:42.999334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f67409d9d974d6c95ce1d85e35a94b5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.000466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f67409d9d974d6c95ce1d85e35a94b5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.010113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-db9156e0-cfd1-4135-8c23-3e182e189f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f67409d9d974d6c95ce1d85e35a94b5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.018496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 968/1917] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:42 2022] DELETE /identity/v3/users/8f67409d9d974d6c95ce1d85e35a94b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:43.359030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:43.361371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:43.383816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93cb48-4f54-43ce-a164-73d05ac5e316 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:43.445014 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:43.445975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.446256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.446585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] PATH_INFO: `/v3/projects/738e5fda79cc40378b396f669c530291` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.447759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738e5fda79cc40378b396f669c530291)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:43.449722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:43.497027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:43.508701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738e5fda79cc40378b396f669c530291', 'request_id': 'req-64f5096e-6744-4345-b95c-5e903252ffe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.519013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738e5fda79cc40378b396f669c530291', 'request_id': 'req-64f5096e-6744-4345-b95c-5e903252ffe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.526664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738e5fda79cc40378b396f669c530291', 'request_id': 'req-64f5096e-6744-4345-b95c-5e903252ffe7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.540699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] The token cache is being invalidate because project 738e5fda79cc40378b396f669c530291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:43.541127 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.542018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64f5096e-6744-4345-b95c-5e903252ffe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:43.543710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 950/1918] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:43 2022] DELETE /identity/v3/projects/738e5fda79cc40378b396f669c530291 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:43.549633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.550173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.550534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.571788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:43.573030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:43.651026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 969/1919] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:43.660369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.660656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.660931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.688606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:43.689841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:43.699373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 951/1920] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:43.703928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:43.717258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b7a9-8fcc-4eaf-bcb3-72f3d99b88a9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:43.723578 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:43.729453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.729770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.730049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.730725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:43.731059 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:43.732644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:43.750805 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:43.753863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 970/1921] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:43.769840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1c106-2f26-47f2-945a-159a8e19cd6c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:43.769840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:43.769840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.769840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.770224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.770224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:43.771624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:43.810420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 952/1922] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:43 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:43.811145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:43.824603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c8b8-cee9-4191-bc9c-3bd30f1e199f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:43.838598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:43.943506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:43.947366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:43.947666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:43.947983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:43.948859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:43.950978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:43.992320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.001079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 971/1923] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:43 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:44.006050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d517b-a7c5-4229-80f0-72388d8f74e3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.012901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.013833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.014212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.014582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.015581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.017432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.057178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.068210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 953/1924] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:44.074698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c58eac-7f7b-4055-9eed-1f22763c2200 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.086081 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.087051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.087512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.097642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.104151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.109035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6582ee-3a17-49a8-8e44-77a12be5fded admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.139412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.139995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 972/1925] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:44.158401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5fec-8011-4fa0-9583-c4b078206298 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.164913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.165723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.166069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.166411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] PATH_INFO: `/v3/projects/fb6462501dcb4f428e1fccfd80ed4b92/users/5900aeb412104388bf84e89d35184fab/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.190743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6462501dcb4f428e1fccfd80ed4b92, user_id=5900aeb412104388bf84e89d35184fab, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.194145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.221211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 954/1926] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:44 2022] PUT /identity/v3/projects/fb6462501dcb4f428e1fccfd80ed4b92/users/5900aeb412104388bf84e89d35184fab/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:44.223621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.224203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.224641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.299552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] MFA Rules not processed for user `5900aeb412104388bf84e89d35184fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:44.307896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:44.428281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 973/1927] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:44.432834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.532091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a81c-1423-4f34-b1ce-2dcf197087f6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.538920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.539546 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.539829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.540103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.540762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.542744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.580324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 955/1928] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:44 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:44.581984 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.593305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c80d56-3586-4781-945d-7211f43d769c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.667265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.668009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.668384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.668750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.669471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.671442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.701949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 974/1929] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:44 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:44.702729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.715757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d6f-2001-47fd-95af-690451a13bce admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.720844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.721515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.722008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.722407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.723002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.724670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.739890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 956/1930] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:45:44.741692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.755959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de03f9-1a59-474e-8d97-7fb1e43ba8d1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.762271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.763195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.763606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.763989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] PATH_INFO: `/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02/users/a5f68c21075e4071b575479746e40259/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.778782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:44.787671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8401db3f1ce9436a8c5f03997fb1cd02, user_id=a5f68c21075e4071b575479746e40259, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.791609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.813479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 975/1931] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:44 2022] PUT /identity/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02/users/a5f68c21075e4071b575479746e40259/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:44.814855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.826330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521a4e-79c2-4325-a86a-ec30a3678bc6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.881313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:44.910951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.911648 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.913922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.914245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.914947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.916564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4782c0-a2a2-490c-9a34-9a97221f87d1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.927824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 957/1932] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:44.933685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:44.950209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f80c-a55f-46ed-8c60-8c9f3064342f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:44.955971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:44.957104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.957549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.957867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] PATH_INFO: `/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02/users/a5f68c21075e4071b575479746e40259/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:44.961911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8401db3f1ce9436a8c5f03997fb1cd02, user_id=a5f68c21075e4071b575479746e40259, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:44.965597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:44.979931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 976/1933] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:44 2022] PUT /identity/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02/users/a5f68c21075e4071b575479746e40259/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:44.991905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:44.992198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:44.992537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:45.045891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] MFA Rules not processed for user `a5f68c21075e4071b575479746e40259`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:45.047470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:45.168642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 958/1934] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:45.179840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:45.181562 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:45.252167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:45.259062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:45.299224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a639d8-a93d-4097-b854-a6ba9abd91d4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:45.305304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:45.306469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:45.306808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:45.307137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:45.328525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:45.330150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba162a-811d-4b06-b780-ae157fd1b8d2 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:45.342270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 977/1935] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:45.447977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44724d3f-f787-44dd-a02f-343bf621822e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:45.472341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:45.473720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:45.474136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:45.474574 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] PATH_INFO: `/v3/users/e784022a428844f184002fdfc8877d9a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:45.475920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e784022a428844f184002fdfc8877d9a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:45.479118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:45.593615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e784022a428844f184002fdfc8877d9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:45.594314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e784022a428844f184002fdfc8877d9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:45.610234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e784022a428844f184002fdfc8877d9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:45.618175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:45.660695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e784022a428844f184002fdfc8877d9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:45.672891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e784022a428844f184002fdfc8877d9a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:45.694275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 959/1936] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:45 2022] DELETE /identity/v3/users/e784022a428844f184002fdfc8877d9a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:45.696085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:45.696363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:45.696632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:45.745711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:45.746798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:45.862802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 978/1937] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:45.875069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:45.876525 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:45.973652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4ba6-5ab6-432a-b0ad-8980fc40d28f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:45.976469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:45.977142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:45.977419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:45.977721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:45.990777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:45.993349 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1383-f402-40d9-bec5-8dae6394c967 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:46.011638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 960/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:46.355415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:46.357065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:46.370915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c9d6-0c8f-42a1-93cf-db84deeed14f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:46.376758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:46.377566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:46.378002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:46.378529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] PATH_INFO: `/v3/users/5900aeb412104388bf84e89d35184fab` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:46.381294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5900aeb412104388bf84e89d35184fab)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:46.383607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:46.479832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5900aeb412104388bf84e89d35184fab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.491422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5900aeb412104388bf84e89d35184fab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.511445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5900aeb412104388bf84e89d35184fab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.513940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5900aeb412104388bf84e89d35184fab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.516977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:46.524093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5900aeb412104388bf84e89d35184fab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.538697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:46.539431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:46.539431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:46.545386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 979/1939] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:46 2022] DELETE /identity/v3/users/5900aeb412104388bf84e89d35184fab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:46.588713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:46.590076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:46.613897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:46.615534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:46.737114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 961/1940] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:46.750115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:46.752582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:46.802580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c626-12ab-40ba-ad0c-47a55576a885 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:46.808586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:46.811404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:46.811810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:46.812089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] PATH_INFO: `/v3/projects/21d6843d68034c1d8b6a902fc25b4a6f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:46.818731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d6843d68034c1d8b6a902fc25b4a6f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:46.821480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:46.854519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9679a-73ef-4cb0-a7fb-61cbb23a0c4a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:46.867119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:46.868335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:46.869077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:46.869412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:46.880685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:46.882237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:46.895355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 962/1941] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:45:46.896882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d6843d68034c1d8b6a902fc25b4a6f', 'request_id': 'req-c0380c99-d9fe-4384-a830-ecf89239e90b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.908005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d6843d68034c1d8b6a902fc25b4a6f', 'request_id': 'req-c0380c99-d9fe-4384-a830-ecf89239e90b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.915497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d6843d68034c1d8b6a902fc25b4a6f', 'request_id': 'req-c0380c99-d9fe-4384-a830-ecf89239e90b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.933011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] The token cache is being invalidate because project 21d6843d68034c1d8b6a902fc25b4a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:46.933421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.934388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:46.936031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 980/1942] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:46 2022] DELETE /identity/v3/projects/21d6843d68034c1d8b6a902fc25b4a6f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:46.940257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:46.952880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcfa1e-1a25-446a-9e42-911caf830132 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:46.983274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:47.043700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:47.044482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:47.044762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:47.045026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] PATH_INFO: `/v3/users/e5347f0efbf749acbcd8cc409b5dc78c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:47.046209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5347f0efbf749acbcd8cc409b5dc78c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:47.048132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:47.125650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5347f0efbf749acbcd8cc409b5dc78c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.126356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5347f0efbf749acbcd8cc409b5dc78c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.142457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5347f0efbf749acbcd8cc409b5dc78c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.162569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5347f0efbf749acbcd8cc409b5dc78c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.170845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5347f0efbf749acbcd8cc409b5dc78c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.182146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 963/1943] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:46 2022] DELETE /identity/v3/users/e5347f0efbf749acbcd8cc409b5dc78c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:47.527547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:47.529274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:47.546114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380c99-d9fe-4384-a830-ecf89239e90b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:47.584890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:47.587175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:47.689836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:47.690582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:47.691010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:47.691354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] PATH_INFO: `/v3/projects/fb6462501dcb4f428e1fccfd80ed4b92` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:47.692762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6462501dcb4f428e1fccfd80ed4b92)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:47.694710 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:47.729035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674fbe-810b-4f66-bbcd-75906109178f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:47.729227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:47.739297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:47.740429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:47.748408 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:47.748714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] PATH_INFO: `/v3/projects/6a9b67b06e2a43789cde775c7270aa96` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:47.750022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9b67b06e2a43789cde775c7270aa96)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:47.751965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:47.763219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6462501dcb4f428e1fccfd80ed4b92', 'request_id': 'req-e57a866e-c144-44a1-9ad8-e11038d1064e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.776506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6462501dcb4f428e1fccfd80ed4b92', 'request_id': 'req-e57a866e-c144-44a1-9ad8-e11038d1064e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.789226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6462501dcb4f428e1fccfd80ed4b92', 'request_id': 'req-e57a866e-c144-44a1-9ad8-e11038d1064e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.824392 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:47.825158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] The token cache is being invalidate because project fb6462501dcb4f428e1fccfd80ed4b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:47.825563 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.826522 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.831873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9b67b06e2a43789cde775c7270aa96', 'request_id': 'req-366de185-1c6d-49b1-ad19-52baa99cf7b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.832392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 981/1944] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:47 2022] DELETE /identity/v3/projects/fb6462501dcb4f428e1fccfd80ed4b92 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:47.837617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:47.839078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:47.871287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9b67b06e2a43789cde775c7270aa96', 'request_id': 'req-366de185-1c6d-49b1-ad19-52baa99cf7b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.887309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9b67b06e2a43789cde775c7270aa96', 'request_id': 'req-366de185-1c6d-49b1-ad19-52baa99cf7b0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.915508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] The token cache is being invalidate because project 6a9b67b06e2a43789cde775c7270aa96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:47.915848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.922227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:47.925065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 964/1945] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:47 2022] DELETE /identity/v3/projects/6a9b67b06e2a43789cde775c7270aa96 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:45:47.930346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:47.935514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:47.975386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a866e-c144-44a1-9ad8-e11038d1064e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:48.067786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:48.068469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:48.069406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:48.069725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] PATH_INFO: `/v3/users/a5f68c21075e4071b575479746e40259` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:48.071184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f68c21075e4071b575479746e40259)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:48.073130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:48.132470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de185-1c6d-49b1-ad19-52baa99cf7b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:48.156676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:48.158523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:48.158807 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:48.159619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] PATH_INFO: `/v3/users/8f974cf10be34bfc8726185fc484a4c3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:48.161238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f974cf10be34bfc8726185fc484a4c3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:48.171609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:48.201036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f68c21075e4071b575479746e40259'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.220673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f68c21075e4071b575479746e40259'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.230047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:48.245477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f974cf10be34bfc8726185fc484a4c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.246669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f974cf10be34bfc8726185fc484a4c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.263651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f974cf10be34bfc8726185fc484a4c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.264070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f68c21075e4071b575479746e40259'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.264845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f68c21075e4071b575479746e40259'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.285874 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f974cf10be34bfc8726185fc484a4c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.287034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f68c21075e4071b575479746e40259'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.295951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f974cf10be34bfc8726185fc484a4c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:48.304982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 982/1946] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:47 2022] DELETE /identity/v3/users/a5f68c21075e4071b575479746e40259 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:48.321237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 965/1947] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:47 2022] DELETE /identity/v3/users/8f974cf10be34bfc8726185fc484a4c3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:48.761777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:48.763633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:48.825955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:48.828198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:48.922936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628531fc-e102-4929-8b7c-6607ba6628e3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:48.946842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:48.973171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46455a-2b38-4754-80b0-74d4c7bfcfbf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:48.978223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:48.979126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:48.980070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:48.980454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] PATH_INFO: `/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:48.981840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8401db3f1ce9436a8c5f03997fb1cd02)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:48.983880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.031123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.031789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.032074 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.032345 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] PATH_INFO: `/v3/projects/4cdbe50730034b61b37cf26478a885ae` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.033759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdbe50730034b61b37cf26478a885ae)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.036007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.094949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8401db3f1ce9436a8c5f03997fb1cd02', 'request_id': 'req-ec608917-7a3e-4443-a4c7-c8030fa20bb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.115411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8401db3f1ce9436a8c5f03997fb1cd02', 'request_id': 'req-ec608917-7a3e-4443-a4c7-c8030fa20bb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.129412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8401db3f1ce9436a8c5f03997fb1cd02', 'request_id': 'req-ec608917-7a3e-4443-a4c7-c8030fa20bb7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.149447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] The token cache is being invalidate because project 8401db3f1ce9436a8c5f03997fb1cd02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:49.165086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.165086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec608917-7a3e-4443-a4c7-c8030fa20bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.165086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 966/1948] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:48 2022] DELETE /identity/v3/projects/8401db3f1ce9436a8c5f03997fb1cd02 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:49.168890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdbe50730034b61b37cf26478a885ae', 'request_id': 'req-ca8879d8-c8b7-4c77-b801-d0c666017399'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.175627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.177918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.189131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.194276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdbe50730034b61b37cf26478a885ae', 'request_id': 'req-ca8879d8-c8b7-4c77-b801-d0c666017399'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.206994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdbe50730034b61b37cf26478a885ae', 'request_id': 'req-ca8879d8-c8b7-4c77-b801-d0c666017399'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.233625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:49.233625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:49.241632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] The token cache is being invalidate because project 4cdbe50730034b61b37cf26478a885ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:49.241632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.251892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ca8879d8-c8b7-4c77-b801-d0c666017399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:49.253926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 983/1949] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:48 2022] DELETE /identity/v3/projects/4cdbe50730034b61b37cf26478a885ae => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:49.345641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 967/1950] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:49.359770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.360044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.360316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.399264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:49.401004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:49.409410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 984/1951] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:49.415577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.436288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d23c0-36a7-445d-97ff-9a0c515fb319 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.463967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.464623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.464902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.465178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.465886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:49.466187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.467911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.532778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 968/1952] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:49.534271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.552069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13281e-33ca-477c-9742-ca6e6098a3be None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.570681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.571436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.571843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.572194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.572955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.575005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.589883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:49.637483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 985/1953] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:49 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:49.641364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.658551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da5de-c62a-41ad-b237-681989e37504 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.743285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.744947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.746174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.746463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.747137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.749163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.773980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:49.788024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.788936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 969/1954] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:49 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:49.799430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9fee-0016-443f-a24e-32d330b66cc5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.804341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.804967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.805247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.805516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.806572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.809671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.825166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 986/1955] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:45:49.826231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.840301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d89a-fd4d-4460-bf78-50d29e5cb3b3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.850617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.852455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.853248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.854289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.856065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.859497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fe14f-26e8-4fac-84a7-89cc29ec8a1d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.880984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 970/1956] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:49.883857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:49.900727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679be3ba-fb60-4874-aaaf-4cd390f549cc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:49.929303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:49.930192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:49.930532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:49.930869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] PATH_INFO: `/v3/projects/be11f04ded304ca590d2f6bce5e3cbd1/users/0878cdfc77bf40dcb1e85a3dd3ef7efd/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:49.975761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be11f04ded304ca590d2f6bce5e3cbd1, user_id=0878cdfc77bf40dcb1e85a3dd3ef7efd, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:49.978513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:49.995519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 987/1957] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:49 2022] PUT /identity/v3/projects/be11f04ded304ca590d2f6bce5e3cbd1/users/0878cdfc77bf40dcb1e85a3dd3ef7efd/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:50.005950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:50.006454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:50.007153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:50.065616 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] MFA Rules not processed for user `0878cdfc77bf40dcb1e85a3dd3ef7efd`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:50.066312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:50.151261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 971/1958] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:50.159435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:50.161516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:50.259806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562e58-14db-45c3-8a4c-eef1b5e962c7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:50.264771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:50.266255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:50.267197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:50.267536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:50.279084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:50.280525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc17f69-bec8-4432-aef9-a0a6fe69c60b service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:50.293158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 988/1959] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:50.317268 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:50.408340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf05d1-9ca9-4d4b-86a4-2ee58bb3cbbc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:50.418458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:50.419204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:50.419555 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:50.419897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] PATH_INFO: `/v3/users/0878cdfc77bf40dcb1e85a3dd3ef7efd` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:50.421433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0878cdfc77bf40dcb1e85a3dd3ef7efd)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:50.429866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:50.549799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0878cdfc77bf40dcb1e85a3dd3ef7efd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:50.550830 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0878cdfc77bf40dcb1e85a3dd3ef7efd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:50.561357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0878cdfc77bf40dcb1e85a3dd3ef7efd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:50.590465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0878cdfc77bf40dcb1e85a3dd3ef7efd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:50.598044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:50.601286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0878cdfc77bf40dcb1e85a3dd3ef7efd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:50.631122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 972/1960] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:50 2022] DELETE /identity/v3/users/0878cdfc77bf40dcb1e85a3dd3ef7efd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:50.633688 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c396674-06bf-4675-b975-2e251f4bac36 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:50.634443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c396674-06bf-4675-b975-2e251f4bac36 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:50.634943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c396674-06bf-4675-b975-2e251f4bac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:50.677614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4c396674-06bf-4675-b975-2e251f4bac36 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:50.679483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c396674-06bf-4675-b975-2e251f4bac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:50.777773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 989/1961] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:50.789341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:50.794979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:50.905620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320b3a-c79b-48fa-89fe-70f3b86bcffa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:50.917438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:50.918561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:50.921435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:50.921633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:50.933279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:50.935396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:50.967318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 973/1962] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:51.038417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.039120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.039838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.071018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:51.074553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:51.171263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:51.195801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 990/1963] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:51.223303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:51.224998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:51.351073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ddd60-58e3-4675-9914-8edf102e97ce service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:51.358915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:51.359815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.360097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.360668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.370861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:51.372490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43777-bb0e-4e7d-8dcd-5f8d2e25e38c service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:51.383085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 974/1964] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:45:51.470209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:51.474068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:51.496874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7b5b-6687-4a30-81c2-39926f40c7c0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:51.502296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:51.503221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.503591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.504016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] PATH_INFO: `/v3/projects/be11f04ded304ca590d2f6bce5e3cbd1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.505370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be11f04ded304ca590d2f6bce5e3cbd1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:51.507968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:51.598376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be11f04ded304ca590d2f6bce5e3cbd1', 'request_id': 'req-14dca586-3481-4466-91fd-7a915392a980'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:51.622057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be11f04ded304ca590d2f6bce5e3cbd1', 'request_id': 'req-14dca586-3481-4466-91fd-7a915392a980'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:51.627818 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be11f04ded304ca590d2f6bce5e3cbd1', 'request_id': 'req-14dca586-3481-4466-91fd-7a915392a980'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:51.645703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] The token cache is being invalidate because project be11f04ded304ca590d2f6bce5e3cbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:45:51.646078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:51.646881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14dca586-3481-4466-91fd-7a915392a980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:51.648878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 991/1965] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:45:51 2022] DELETE /identity/v3/projects/be11f04ded304ca590d2f6bce5e3cbd1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:51.654453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.655119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.656327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.689708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:51.691271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:51.788667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 975/1966] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:51.797755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.798038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.798491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.824548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:51.826089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:51.837354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 992/1967] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:51.840346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:51.856069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61a90-cc07-4296-893b-9c86e6300fc9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:51.861119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:51.861915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.862837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.862837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.863495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:45:51.863879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:51.865631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:51.889968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 976/1968] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:45:51.894529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:51.906814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12fd2-f1d8-44c6-ac9e-a788570fe837 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:51.915725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:51.917965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:51.918455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:51.918916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:51.922547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:51.927390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:51.993527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 993/1969] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:45:51 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:45:51.997543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:52.016929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8906335-890a-49b9-974e-2f35b26f9258 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:52.049022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:52.132240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:52.134202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:52.134490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:52.134760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:52.135473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:52.137423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:52.198048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 977/1970] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:45:51 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:45:52.202782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:52.229530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad9a39-cf0a-409a-9fea-5032401421a1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:52.245758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:52.248947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:52.249833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:52.249833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:52.251274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:52.256718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:52.288680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 994/1971] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:52.292586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:52.312077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461988db-ef43-4ed5-8f6e-80b6172d4f9c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:52.334090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:52.334734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:52.335015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:52.335302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:52.335943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:52.345681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bfae3-9254-4f5d-98a5-44dff63a1932 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:52.393258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 978/1972] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:45:52.397821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:52.419333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac9be-65fa-42ee-84b4-f880aa72f861 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:52.455900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:52.459605 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:52.459885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:52.460154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] PATH_INFO: `/v3/projects/bb33339cb5a640e2b62d7077ad42d9d4/users/ecccb1bf46e44946b6498529005b976f/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:52.540090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb33339cb5a640e2b62d7077ad42d9d4, user_id=ecccb1bf46e44946b6498529005b976f, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:52.543570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:52.572089 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 995/1973] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:45:52 2022] PUT /identity/v3/projects/bb33339cb5a640e2b62d7077ad42d9d4/users/ecccb1bf46e44946b6498529005b976f/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:52.582393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a72d-a2c1-4ab9-9800-aacaddf8f66f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:52.582740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a72d-a2c1-4ab9-9800-aacaddf8f66f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:52.583155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a72d-a2c1-4ab9-9800-aacaddf8f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:52.651659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ab75a72d-a2c1-4ab9-9800-aacaddf8f66f None None] MFA Rules not processed for user `ecccb1bf46e44946b6498529005b976f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:52.656958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ab75a72d-a2c1-4ab9-9800-aacaddf8f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:52.870541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 979/1974] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:45:52.882021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:52.883967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:53.010427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5459b-a768-45dd-9e84-b2d0ca329a69 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:53.015414 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:53.016417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:53.016913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:53.017418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:53.035536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:53.037228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:53.062397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 996/1975] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:45:55.031223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a17d0-15f3-4a84-b31d-6d2d15e22b80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:55.032208 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a17d0-15f3-4a84-b31d-6d2d15e22b80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:55.032952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a17d0-15f3-4a84-b31d-6d2d15e22b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:55.085968 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c07a17d0-15f3-4a84-b31d-6d2d15e22b80 None None] MFA Rules not processed for user `56dbff833b7f452a839852b02fb18672`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:55.087530 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c07a17d0-15f3-4a84-b31d-6d2d15e22b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:55.198274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 980/1976] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:59.375180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:59.405013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:59.480648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f6d7b-92dd-4d79-b19c-f6390a671647 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:59.485957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:59.486594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:59.486899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:59.487174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] PATH_INFO: `/v3/users/ecccb1bf46e44946b6498529005b976f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:59.488424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecccb1bf46e44946b6498529005b976f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:59.491229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:59.572135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecccb1bf46e44946b6498529005b976f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:59.593944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:59.594513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:59.594513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:59.613696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecccb1bf46e44946b6498529005b976f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:59.618757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:59.620271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:59.645071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecccb1bf46e44946b6498529005b976f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:59.646927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecccb1bf46e44946b6498529005b976f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:59.661090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:59.662295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e6f2f97-4367-464a-a3ab-916187f49cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecccb1bf46e44946b6498529005b976f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:45:59.673614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 997/1977] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:45:59 2022] DELETE /identity/v3/users/ecccb1bf46e44946b6498529005b976f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:45:59.681227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:59.681227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:59.681227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:59.705417 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:45:59.706983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:59.723846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 981/1978] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:59.741137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:59.742880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:59.815539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 998/1979] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:45:59.828277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:45:59.831123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:45:59.873949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f96d2-654d-4a71-b973-c0398845e5a8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:59.915543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:45:59.948681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cdd7-1f35-464d-8eb0-ede3804a3499 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:45:59.957929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:59.958774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:59.959045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:59.959314 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:45:59.981066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:45:59.983136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:45:59.992786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:45:59.992786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:45:59.993116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:45:59.993453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:00.009265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 999/1980] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:00.132231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:00.136599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c61b7-53c4-49f3-a2b8-5f55430fb38c service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:00.152152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 982/1981] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 17:46:00.482917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:00.484897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:00.508333 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281bbe-d303-479b-ad45-b42cbebfd9f0 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:00.552927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:00.553831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:00.554619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:00.555381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] PATH_INFO: `/v3/projects/bb33339cb5a640e2b62d7077ad42d9d4` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:00.556918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb33339cb5a640e2b62d7077ad42d9d4)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:00.559243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:00.635833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb33339cb5a640e2b62d7077ad42d9d4', 'request_id': 'req-06090855-2f45-48eb-864e-dc28be6d69e2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:00.645461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb33339cb5a640e2b62d7077ad42d9d4', 'request_id': 'req-06090855-2f45-48eb-864e-dc28be6d69e2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:00.652767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb33339cb5a640e2b62d7077ad42d9d4', 'request_id': 'req-06090855-2f45-48eb-864e-dc28be6d69e2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:00.681393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] The token cache is being invalidate because project bb33339cb5a640e2b62d7077ad42d9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:46:00.681739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:00.682591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-06090855-2f45-48eb-864e-dc28be6d69e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:00.684307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1000/1982] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:46:00 2022] DELETE /identity/v3/projects/bb33339cb5a640e2b62d7077ad42d9d4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:00.689321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:00.689915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:00.689915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:00.721806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:00.723988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:00.740198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:00.850571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 983/1983] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:00.859062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:00.859400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:00.859675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:00.896425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:00.897723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:00.908165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1001/1984] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:00.913431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:00.941478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773254cc-7d8f-4fac-b4e4-c1d854f1ba1c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:00.959325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:00.959964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:00.960450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:00.960720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:00.961385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:46:00.961721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:00.963527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:00.988831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 984/1985] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:46:00.995208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.011229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f007-528b-4e02-8021-24e1ece6ed1c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.022140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.024053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.024313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.024577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.025512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.030363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.078486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1002/1986] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:46:00 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:46:01.082476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.103798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab946a1-788c-43e4-b369-3e56a112dcb3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.212779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.213544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.213769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.214072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.214896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.217089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.264228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 985/1987] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:46:01 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:46:01.268729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.286996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c000f5-7e01-4140-80a8-4a249e7b19bb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.293430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.294255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.294671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.294948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.295674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.297670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.317628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1003/1988] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:01.322154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.344375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84951-7f9a-48d9-858d-effa385ac34f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.350686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.351398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.351751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.352164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.352826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.354729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f641-8180-42b6-88eb-057d40dae416 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.368328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 986/1989] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:01.372444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.386091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9cf0-387c-4db0-8c65-bb321b638d46 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.392276 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.393558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.394048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.394048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] PATH_INFO: `/v3/projects/2a642bf03a194f4cb5e2607e6b0f2379/users/eb1b86f956144b61814af5414c026f4a/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.413367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a642bf03a194f4cb5e2607e6b0f2379, user_id=eb1b86f956144b61814af5414c026f4a, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.416309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.456309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1004/1990] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:46:01 2022] PUT /identity/v3/projects/2a642bf03a194f4cb5e2607e6b0f2379/users/eb1b86f956144b61814af5414c026f4a/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:01.458322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.459096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.459620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.513280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] MFA Rules not processed for user `eb1b86f956144b61814af5414c026f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:01.514634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:01.625867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 987/1991] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:46:01.635277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:01.639011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:01.719091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231c47-a0be-48f1-9030-964b46a0d43e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:01.723229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:01.723885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:01.724175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:01.724442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:01.751448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:01.753183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:01.774232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1005/1992] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:02.829627 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:02.832142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:02.859798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:02.928730 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464933b-627f-4452-8af9-960902c4f3fd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:02.933688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:02.934869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:02.935166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:02.935443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] PATH_INFO: `/v3/users/5fa576bcd66d4c82b20dfc005eb08a39` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:02.936599 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa576bcd66d4c82b20dfc005eb08a39)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:02.938571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:03.001544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa576bcd66d4c82b20dfc005eb08a39'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.002237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa576bcd66d4c82b20dfc005eb08a39'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.037816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa576bcd66d4c82b20dfc005eb08a39'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.077008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa576bcd66d4c82b20dfc005eb08a39'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.092034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92f6fec3-5c5a-4e36-9ebf-e5be0bd8729c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa576bcd66d4c82b20dfc005eb08a39'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.110894 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 988/1993] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:46:02 2022] DELETE /identity/v3/users/5fa576bcd66d4c82b20dfc005eb08a39 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:03.385809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:03.402746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:03.409155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6dcfa-d0cd-44e2-b4a2-9d553cb7bce0 service glance] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:03.605427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:03.606156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:03.606472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:03.606650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] PATH_INFO: `/v3/projects/ab6e611f93ce4c57964417d89b6c3e14` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:03.607824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6e611f93ce4c57964417d89b6c3e14)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:03.609882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:03.686088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6e611f93ce4c57964417d89b6c3e14', 'request_id': 'req-62447e53-7e37-4211-8dd1-a93b869a3f87'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.700034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6e611f93ce4c57964417d89b6c3e14', 'request_id': 'req-62447e53-7e37-4211-8dd1-a93b869a3f87'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.713003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6e611f93ce4c57964417d89b6c3e14', 'request_id': 'req-62447e53-7e37-4211-8dd1-a93b869a3f87'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.739677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] The token cache is being invalidate because project ab6e611f93ce4c57964417d89b6c3e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:46:03.740233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.741352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-62447e53-7e37-4211-8dd1-a93b869a3f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:03.743931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1006/1994] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:46:03 2022] DELETE /identity/v3/projects/ab6e611f93ce4c57964417d89b6c3e14 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:03.749346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:03.749791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:03.750099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:03.776799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:03.778219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:03.851235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 989/1995] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:03.858613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:03.858963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:03.859304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:03.881662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:03.882953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:03.891234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1007/1996] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:03.895912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:03.909433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26c5e-14e8-4ece-85b6-28ab33d64d30 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:03.919426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:03.921329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:03.922611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:03.922969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:03.925775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:46:03.926204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:03.928077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:03.951107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 990/1997] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:46:03.955544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:03.968001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a546e-9df2-457c-9a5f-7877be700ffa None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:03.974615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:03.975335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:03.975708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:03.976045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:03.976728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:03.980704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.025662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1008/1998] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:46:03 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:46:04.029550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.048136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e10e77-3aa4-453d-8143-f4fe0394484e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.073528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:04.170620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.171354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.171850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.172128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.172804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.175068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.214846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.225391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 991/1999] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:46:04 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:46:04.227349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5b963-1d0d-416f-91a8-6fe8423b14c3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.233482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.234823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.235245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.235794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.236598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.238687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.254839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.263369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1009/2000] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:04.267230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360158-c3f9-433c-95eb-c58419b06d3c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.276084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.277178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.277719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.278145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.278979 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.280774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42be27-81c2-46e4-b432-6af6f28ea960 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.293543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 992/2001] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:46:04.298072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.310106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aacea-7657-4522-90f2-85d8b69a471a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.322374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.325851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.326326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.326770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] PATH_INFO: `/v3/projects/ce54d2924ef94cc9a4d224b22c0363a2/users/c492b80caf044d1fa3b8eaf45cdbac8d/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.363763 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce54d2924ef94cc9a4d224b22c0363a2, user_id=c492b80caf044d1fa3b8eaf45cdbac8d, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.369362 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.394379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1010/2002] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:46:04 2022] PUT /identity/v3/projects/ce54d2924ef94cc9a4d224b22c0363a2/users/c492b80caf044d1fa3b8eaf45cdbac8d/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:04.406360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.407814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.408367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.456097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] MFA Rules not processed for user `c492b80caf044d1fa3b8eaf45cdbac8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:04.456810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:04.572024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 993/2003] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:46:04.583863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.586286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:04.632704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:04.671056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6a47-5f97-4625-8a80-58658ef121b0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.675456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.676104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.676451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.676808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.687682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.689113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a021e80-e1ca-4e81-8f6e-38e509f4029e service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.707546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1011/2004] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:04.753909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:04.841116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791513db-2666-4a9b-b20e-e5c10b1646c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:04.845969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:04.847038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.847335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.848373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] PATH_INFO: `/v3/users/c492b80caf044d1fa3b8eaf45cdbac8d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.850224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c492b80caf044d1fa3b8eaf45cdbac8d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:04.852651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:04.889114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:04.905375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c492b80caf044d1fa3b8eaf45cdbac8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:04.906048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c492b80caf044d1fa3b8eaf45cdbac8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:04.914945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c492b80caf044d1fa3b8eaf45cdbac8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:04.927711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c492b80caf044d1fa3b8eaf45cdbac8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:04.936451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c492b80caf044d1fa3b8eaf45cdbac8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:04.944156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 994/2005] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:46:04 2022] DELETE /identity/v3/users/c492b80caf044d1fa3b8eaf45cdbac8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:46:04.948743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:04.949029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:04.949302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:04.968781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:04.969915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:05.040997 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1012/2006] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:05.049740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.051565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:05.117754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb17d0-dc98-4a27-95c6-a88f1323d37d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.122007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.122624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.122902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.123171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.133023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.134485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b32c19-b557-4b9f-8d72-7ea13f0534b0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:05.144889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 995/2007] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:05.420821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.422339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:05.452549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528fa21-4032-47cd-ae23-2f415b0fcdfd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.464426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.465095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.465375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.465695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] PATH_INFO: `/v3/projects/ce54d2924ef94cc9a4d224b22c0363a2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.466944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce54d2924ef94cc9a4d224b22c0363a2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.468911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:05.522871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce54d2924ef94cc9a4d224b22c0363a2', 'request_id': 'req-e54e2174-794e-4c9d-8cc9-e704be90480c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:05.530762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce54d2924ef94cc9a4d224b22c0363a2', 'request_id': 'req-e54e2174-794e-4c9d-8cc9-e704be90480c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:05.537035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce54d2924ef94cc9a4d224b22c0363a2', 'request_id': 'req-e54e2174-794e-4c9d-8cc9-e704be90480c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:05.556426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] The token cache is being invalidate because project ce54d2924ef94cc9a4d224b22c0363a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:46:05.556837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:05.557679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e54e2174-794e-4c9d-8cc9-e704be90480c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:05.559213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1013/2008] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:46:05 2022] DELETE /identity/v3/projects/ce54d2924ef94cc9a4d224b22c0363a2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:05.564417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.564818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.565143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.608278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:05.609723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:05.681916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 996/2009] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:05.690530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.690872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.691731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.723461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:05.724701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:05.733111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1014/2010] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:05.737450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.748114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d7f80-83b9-47d7-b115-119c47534836 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.752817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.753436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.753837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.754108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.754752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:46:05.755051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.756680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:05.777712 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 997/2011] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:46:05.780490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.790531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dedd0-69ff-4919-944e-9547e9ad9faa None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.795750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.796352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.796632 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.796915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.797543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.799743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:05.848872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1015/2012] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:46:05 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:46:05.850698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.862335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ec42-375d-4625-8d54-6670507167cc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.903746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:05.930526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.931218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.931562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.931899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.932597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.934638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:05.959047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 998/2013] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:46:05 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:46:05.963049 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:05.975524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0562ac-ee3c-4722-a239-8378f2be4ee3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:05.985239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:05.985976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:05.986258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:05.986610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:05.987335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:05.989285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:06.003506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1016/2014] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:06.007497 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:06.018560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60544b-337a-4769-953c-c2af4dd887c9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:06.026433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:06.027068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:06.027349 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:06.027624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:06.028350 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:06.029969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b647c-eb54-4ca1-b09f-4eb9c08ac01e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:06.041877 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 999/2015] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:06.046132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:06.063967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10c11-04e3-419e-8a43-c2cb186f1b3b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:06.072931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:06.074508 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:06.076026 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:06.077257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] PATH_INFO: `/v3/projects/2d010c7efb6542528ddfc3c9e94d5f93/users/e75484121670479f8dc59da8f216d8d8/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:06.100960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d010c7efb6542528ddfc3c9e94d5f93, user_id=e75484121670479f8dc59da8f216d8d8, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:06.104303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:06.106927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:06.124748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1017/2016] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:46:06 2022] PUT /identity/v3/projects/2d010c7efb6542528ddfc3c9e94d5f93/users/e75484121670479f8dc59da8f216d8d8/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:06.131087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39caa-efed-4729-9c32-02db1570a7b0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:06.131511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39caa-efed-4729-9c32-02db1570a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:06.131676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf39caa-efed-4729-9c32-02db1570a7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:06.151995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cf39caa-efed-4729-9c32-02db1570a7b0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:06.153210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cf39caa-efed-4729-9c32-02db1570a7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:06.215953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1000/2017] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:06.226251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:06.228343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:06.296408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8def3-bb90-4430-9bcf-1972b4884322 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:06.302981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:06.302981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:06.302981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:06.302981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:06.314900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:06.316978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:06.332986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1018/2018] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:07.642262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba5f1-397d-47a8-ae33-d4ff6df9adb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:07.642763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba5f1-397d-47a8-ae33-d4ff6df9adb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:07.642907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba5f1-397d-47a8-ae33-d4ff6df9adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:07.679589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d36ba5f1-397d-47a8-ae33-d4ff6df9adb4 None None] MFA Rules not processed for user `e75484121670479f8dc59da8f216d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:07.681373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d36ba5f1-397d-47a8-ae33-d4ff6df9adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:07.767085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1001/2019] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:07.782223 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:07.784701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:07.877944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492e75-7eb1-4a8e-8b45-ef9dabadfe64 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:07.881895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:07.882530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:07.882788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:07.883064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:07.892170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:07.893953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a018f4-a3a1-4f24-afce-3268bc11087b service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:07.903877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1019/2020] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:46:09.354752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f86a4-eccc-484e-9cbd-3f24f1b6daa1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:09.355282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f86a4-eccc-484e-9cbd-3f24f1b6daa1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:09.355411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f86a4-eccc-484e-9cbd-3f24f1b6daa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:09.380209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-496f86a4-eccc-484e-9cbd-3f24f1b6daa1 None None] MFA Rules not processed for user `e75484121670479f8dc59da8f216d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:09.381446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-496f86a4-eccc-484e-9cbd-3f24f1b6daa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:09.390702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1002/2021] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:11.638275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:11.639407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:11.639866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:11.642001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1020/2022] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:46:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:46:11.650526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25f94-4e14-4c9e-9fdf-4d9aaceec6fb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:11.651061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25f94-4e14-4c9e-9fdf-4d9aaceec6fb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:11.651316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b25f94-4e14-4c9e-9fdf-4d9aaceec6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:11.677121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c0b25f94-4e14-4c9e-9fdf-4d9aaceec6fb None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:11.678375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c0b25f94-4e14-4c9e-9fdf-4d9aaceec6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:11.713382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:11.749355 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1003/2023] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:11.760759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:11.763683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:11.837259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc51cc0-f145-42ca-a473-ef0571f448d9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:11.840784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:11.841396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:11.841704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:11.841976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:11.857951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:11.859623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6adbf9-e2b3-4052-b5c7-152a12d23273 service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:11.873244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1021/2024] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:11.947686 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd000-8297-4d55-9253-fa636bfa6523 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:11.948092 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd000-8297-4d55-9253-fa636bfa6523 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:11.948455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd000-8297-4d55-9253-fa636bfa6523 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:11.950044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1004/2025] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:46:11.956030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31ffd-8be8-4405-9f04-0b5cf687e387 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:11.956374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31ffd-8be8-4405-9f04-0b5cf687e387 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:11.956609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31ffd-8be8-4405-9f04-0b5cf687e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:11.977675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2fa31ffd-8be8-4405-9f04-0b5cf687e387 None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:11.978907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2fa31ffd-8be8-4405-9f04-0b5cf687e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:11.986050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1022/2026] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:11.999261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd000-8297-4d55-9253-fa636bfa6523 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:12.012138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd000-8297-4d55-9253-fa636bfa6523 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:12.016407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:12.017012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:12.017290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:12.017564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:12.025935 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:12.027370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbad9c8-cb24-4b23-ba04-fa2275df1c95 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:12.036024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1005/2027] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:12.119290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9f-408d-4df0-a919-dac54c6180a8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:12.119572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9f-408d-4df0-a919-dac54c6180a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:12.119837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9f-408d-4df0-a919-dac54c6180a8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:12.121231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1023/2028] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 17:46:12.127635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f25a-ab20-4801-abc0-4289f8d4a394 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:12.127970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f25a-ab20-4801-abc0-4289f8d4a394 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:12.128267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f25a-ab20-4801-abc0-4289f8d4a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:12.152017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5967f25a-ab20-4801-abc0-4289f8d4a394 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:12.153235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5967f25a-ab20-4801-abc0-4289f8d4a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:12.165226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1006/2029] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:46:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:12.178438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147c9f-408d-4df0-a919-dac54c6180a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:12.193124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147c9f-408d-4df0-a919-dac54c6180a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:12.197516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:12.198157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:12.198437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:12.198711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:12.211172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:12.212981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:12.230151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1024/2030] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:17.920053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:17.920557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:17.920557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:17.940246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:17.941442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:18.000385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1007/2031] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:18.012651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:18.014159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:18.041367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:18.088101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737924-c81e-4557-b8dd-9169b32888e9 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:18.093634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:18.094248 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:18.094527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:18.094798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:18.108070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:18.110231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb3c7-5fd7-4330-9115-ed67aa26e258 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:18.121221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1025/2032] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:46:26.801142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:26.802811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:26.817351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf049f22-965e-4303-af0b-446a9693b5ee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:26.822206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:26.822834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:26.823109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:26.823488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] PATH_INFO: `/v3/users/eb1b86f956144b61814af5414c026f4a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:26.824732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1b86f956144b61814af5414c026f4a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:26.826955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:26.880995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1b86f956144b61814af5414c026f4a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:26.881680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1b86f956144b61814af5414c026f4a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:26.888981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1b86f956144b61814af5414c026f4a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:26.901468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1b86f956144b61814af5414c026f4a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:26.908549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1b86f956144b61814af5414c026f4a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:26.914704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1008/2033] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:46:26 2022] DELETE /identity/v3/users/eb1b86f956144b61814af5414c026f4a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:26.919318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:26.919838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:26.919838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:26.940458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:26.941930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:27.003340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1026/2034] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:27.015150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.016561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:27.054232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:27.084023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184834ad-063f-4f1e-a59d-fd06800e038a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.087977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.088649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.089538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.089538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.099620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.101152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b9df4-c763-4475-ab88-bb96935cc187 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.111704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1009/2035] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:27.394874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.396702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:27.410154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2870a9-9aef-47ee-957e-51b2c283871e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.415022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.415717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.415962 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.416267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] PATH_INFO: `/v3/projects/2a642bf03a194f4cb5e2607e6b0f2379` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.417401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a642bf03a194f4cb5e2607e6b0f2379)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.419484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.473046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a642bf03a194f4cb5e2607e6b0f2379', 'request_id': 'req-5583b9d1-054f-403d-b1fd-a9711b2cada4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:27.481451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a642bf03a194f4cb5e2607e6b0f2379', 'request_id': 'req-5583b9d1-054f-403d-b1fd-a9711b2cada4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:27.487265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a642bf03a194f4cb5e2607e6b0f2379', 'request_id': 'req-5583b9d1-054f-403d-b1fd-a9711b2cada4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:27.498869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] The token cache is being invalidate because project 2a642bf03a194f4cb5e2607e6b0f2379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:46:27.499168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:27.499786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5583b9d1-054f-403d-b1fd-a9711b2cada4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:27.501310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1027/2036] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:46:27 2022] DELETE /identity/v3/projects/2a642bf03a194f4cb5e2607e6b0f2379 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:27.507267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.507549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.507816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.527669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:27.528863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:27.593819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1010/2037] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:27.601768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.602057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.602652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.624807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:27.626166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:27.634394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1028/2038] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:27.638601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.649271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdf1e8-931f-481a-917c-d6aa819f5fe5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.654249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.654880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.655168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.655471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.656129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:46:27.656435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.658103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.670985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1011/2039] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:46:27.675721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.685836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9237-341e-4b57-a9cb-501fd6997364 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.691839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.692440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.692712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.692977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.693610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.695561 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.726406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1029/2040] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:46:27 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:46:27.731031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.744711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569609-a78a-49d5-b3c6-f0dd651e1b27 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.805305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.806011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.806138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.806401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.807048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.808988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.839551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1012/2041] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:46:27 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:46:27.844630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.861434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c542-8cd0-4c14-9101-c50a5583b6dc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.867394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.868042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.868363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.868640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.869326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.871129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.873010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:27.886142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1030/2042] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:27.890402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.901034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b038-9199-4c78-86b7-6a8231a3b4b5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.906794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.907404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.907667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.907940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.908579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.910634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f209b28-cc25-4e98-b9da-d9e73626ec23 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.921513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1013/2043] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:46:27.926560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:27.937304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d40a03-3be1-44b6-97f1-18e897d97dcf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:27.943287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:27.943947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.944224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.944496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] PATH_INFO: `/v3/projects/7f649043c6ec4134aec09e0411ad157c/users/86c2fc531d414a259d1cb192b14c7781/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:27.960228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f649043c6ec4134aec09e0411ad157c, user_id=86c2fc531d414a259d1cb192b14c7781, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:27.962989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:27.977837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1031/2044] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:46:27 2022] PUT /identity/v3/projects/7f649043c6ec4134aec09e0411ad157c/users/86c2fc531d414a259d1cb192b14c7781/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:46:27.989883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804cc2-59af-4ae3-8630-03aa8d471ddd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:27.990178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804cc2-59af-4ae3-8630-03aa8d471ddd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:27.990486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c804cc2-59af-4ae3-8630-03aa8d471ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:28.021044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c804cc2-59af-4ae3-8630-03aa8d471ddd None None] MFA Rules not processed for user `86c2fc531d414a259d1cb192b14c7781`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:28.022321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c804cc2-59af-4ae3-8630-03aa8d471ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:28.050404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:28.097100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1014/2045] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:28.113765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:28.115994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:28.180836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9284-7b6a-4e3c-84dc-01a49507698c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:28.185336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:28.185998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:28.186272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:28.186541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:28.196005 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:28.197444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:28.206881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1032/2046] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:38.091743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=15 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:38.203017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:44.732796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916524-f380-4208-90de-9f7028da1805 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:44.733697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916524-f380-4208-90de-9f7028da1805 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:44.733855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916524-f380-4208-90de-9f7028da1805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:44.758650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4c916524-f380-4208-90de-9f7028da1805 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:44.759879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4c916524-f380-4208-90de-9f7028da1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:44.821178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1015/2047] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:46:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:44.845572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:44.847180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:44.926213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ccd4e-d696-408e-8639-3ab2120f238c service glance] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:44.932317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:44.932950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:44.933226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:44.933498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:44.942663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:44.944321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:44.952665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1033/2048] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:46:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:46:54.813749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=25 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:54.949103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=32 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:46:57.005946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:57.006779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:57.006779 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:57.030566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:57.031769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:57.094133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1016/2049] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:46:57.125225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:57.127052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:57.219498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303fed-d3f7-4545-843c-ac217aa8fe02 service swift] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:57.227016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:57.227660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:57.227932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:57.228195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:57.237560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:57.239155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feec6d7-895f-4b7f-be43-c1fa8694f68d service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:57.249147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1034/2050] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:58.425814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:58.436216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722da939-0eb4-4c77-9645-2b8927476c4f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:58.442031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:58.442691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:58.442998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:58.443212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] PATH_INFO: `/v3/users/86c2fc531d414a259d1cb192b14c7781` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:58.444500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c2fc531d414a259d1cb192b14c7781)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:58.446457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:58.496449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c2fc531d414a259d1cb192b14c7781'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:58.497147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c2fc531d414a259d1cb192b14c7781'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:58.505903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c2fc531d414a259d1cb192b14c7781'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:58.518107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c2fc531d414a259d1cb192b14c7781'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:58.525070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c2fc531d414a259d1cb192b14c7781'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:58.531283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1017/2051] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:46:58 2022] DELETE /identity/v3/users/86c2fc531d414a259d1cb192b14c7781 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:46:58.535827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:58.536331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:58.536440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:58.556152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:46:58.557365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:58.618982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1035/2052] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:46:58.631666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:58.633309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:58.694560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06707-4f29-4261-a732-967c0cd6d73d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:58.698470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:58.699081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:58.699358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:58.699625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:58.709273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:58.710758 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a8c7d-cd89-4a44-9fb9-9e7992d398e3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:58.721567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1018/2053] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:46:59.012692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:46:59.014485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:46:59.026975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21255-8a32-405b-a697-af0c4ea5110c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:46:59.032102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:46:59.032802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:46:59.033064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:46:59.033329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] PATH_INFO: `/v3/projects/7f649043c6ec4134aec09e0411ad157c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:46:59.034480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f649043c6ec4134aec09e0411ad157c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:46:59.036385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:46:59.087215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f649043c6ec4134aec09e0411ad157c', 'request_id': 'req-241a6db9-6e14-48cf-a29a-8bb1f1e26509'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:59.095656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f649043c6ec4134aec09e0411ad157c', 'request_id': 'req-241a6db9-6e14-48cf-a29a-8bb1f1e26509'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:59.101922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f649043c6ec4134aec09e0411ad157c', 'request_id': 'req-241a6db9-6e14-48cf-a29a-8bb1f1e26509'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:59.114198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] The token cache is being invalidate because project 7f649043c6ec4134aec09e0411ad157c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:46:59.114487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:59.115257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:46:59.117229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1036/2054] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:46:59 2022] DELETE /identity/v3/projects/7f649043c6ec4134aec09e0411ad157c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:47:00.857981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5a1-7179-495f-80b0-356919a190b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:00.858570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5a1-7179-495f-80b0-356919a190b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:00.858570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5a1-7179-495f-80b0-356919a190b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:00.882961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-baede5a1-7179-495f-80b0-356919a190b3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:00.884764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-baede5a1-7179-495f-80b0-356919a190b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:00.897118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:00.950269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1019/2055] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:00.973347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:00.975408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:00.990859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:01.062247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a6db9-6e14-48cf-a29a-8bb1f1e26509 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:01.068828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:01.069439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:01.069746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:01.070002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:01.078901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:01.080515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:01.090273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1037/2056] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:04.157456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f922a-ccbf-4200-86cd-03cc95038b26 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:04.158081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f922a-ccbf-4200-86cd-03cc95038b26 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:04.158081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f922a-ccbf-4200-86cd-03cc95038b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:04.178952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-214f922a-ccbf-4200-86cd-03cc95038b26 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:04.180154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-214f922a-ccbf-4200-86cd-03cc95038b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:04.189967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1020/2057] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:04.216045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:04.217786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:04.233656 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fae-4c1f-4bcd-9423-5ff9b64328d5 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:04.239324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:04.239917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:04.240172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:04.240467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:04.249475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:04.251084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:04.261658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1038/2058] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:08.286062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d14a7-4bd4-4baf-a419-604475641a5d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:08.286618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d14a7-4bd4-4baf-a419-604475641a5d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:08.286618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d14a7-4bd4-4baf-a419-604475641a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:08.310715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c87d14a7-4bd4-4baf-a419-604475641a5d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:08.312104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c87d14a7-4bd4-4baf-a419-604475641a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:08.322353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1021/2059] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:08.345555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:08.363979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cce3e-3e00-4c44-ae93-4e2b0ff0a725 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:08.371947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:08.372600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:08.372868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:08.373227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:08.382474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:08.384121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:08.394686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1039/2060] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:16.627052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658550c-ea23-4878-9888-9349a5a909a9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:16.627863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658550c-ea23-4878-9888-9349a5a909a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:16.627863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658550c-ea23-4878-9888-9349a5a909a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:16.649688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b658550c-ea23-4878-9888-9349a5a909a9 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:16.650916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b658550c-ea23-4878-9888-9349a5a909a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:16.659950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1022/2061] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:16.686944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:16.698830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ce71-03e5-4549-8cd9-169b33ec2c23 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:16.705900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:16.706568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:16.706911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:16.707205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:16.715769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:16.717379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:16.727761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1040/2062] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:19.807958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:19.808501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:19.808501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:19.829233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:19.830617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:19.839126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1023/2063] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:47:19.875753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:19.887365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e36166-84e1-4654-9cc9-ef7a078261bb service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:19.893198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:19.893831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:19.894112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:19.894405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:19.903385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:19.904949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11df7b-1d2b-4668-9492-fdded85f3155 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:19.914859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1041/2064] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:29.824224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=32 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:29.910468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=54 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:31.211740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:31.213351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:31.286249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1195154-ad4c-4250-b571-9adfadafc7d4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:31.291743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:31.292398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:31.292708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:31.293104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:31.295031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:31.306901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:31.308496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9be1-d2f4-4c8c-8e25-169f2a780fa7 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:31.319141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1024/2065] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:36.162978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2ee1-c6b2-4b65-a6f9-0ba9cb603e1a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:36.163565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2ee1-c6b2-4b65-a6f9-0ba9cb603e1a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:36.163565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2ee1-c6b2-4b65-a6f9-0ba9cb603e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:36.185521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-963d2ee1-c6b2-4b65-a6f9-0ba9cb603e1a None None] MFA Rules not processed for user `e75484121670479f8dc59da8f216d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:36.187520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-963d2ee1-c6b2-4b65-a6f9-0ba9cb603e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:36.269913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1042/2066] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:47:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:47:38.007226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e11-7726-4870-8b22-307a646286e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:38.007725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e11-7726-4870-8b22-307a646286e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:38.007869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e11-7726-4870-8b22-307a646286e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:38.036453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ff5e0e11-7726-4870-8b22-307a646286e4 None None] MFA Rules not processed for user `80168c16c0ca44cb86c9691fda4aab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:38.037708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff5e0e11-7726-4870-8b22-307a646286e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:38.095020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1025/2067] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:47:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:41.552050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:41.552705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:41.552705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:41.573625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] MFA Rules not processed for user `56dbff833b7f452a839852b02fb18672`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:41.574804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:41.642410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1043/2068] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:47:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:48.087674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=57 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:51.632306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=50 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:47:55.218886 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941d1e-5ecd-40e1-877d-8c61e14d153d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:55.219558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941d1e-5ecd-40e1-877d-8c61e14d153d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:55.219558 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941d1e-5ecd-40e1-877d-8c61e14d153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:55.242598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-31941d1e-5ecd-40e1-877d-8c61e14d153d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:55.243905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31941d1e-5ecd-40e1-877d-8c61e14d153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:55.253209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1026/2069] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:55.283499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:55.296737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57258cc-a4ec-49f9-a269-7606f0555933 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:55.303401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:55.304014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:55.304294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:55.304566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:55.313319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:55.315721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:55.325769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1044/2070] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:47:58.489148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c05c-c6d5-4894-9307-f3d44547a463 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:58.489643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c05c-c6d5-4894-9307-f3d44547a463 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:58.489738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c05c-c6d5-4894-9307-f3d44547a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:58.511244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9bb1c05c-c6d5-4894-9307-f3d44547a463 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:47:58.512422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9bb1c05c-c6d5-4894-9307-f3d44547a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:47:58.521757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1027/2071] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:47:58.545086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:47:58.557546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fba8a-3004-4007-9520-a40309feef2b service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:47:58.564162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:47:58.564759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:47:58.565055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:47:58.565317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:47:58.574253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:47:58.575828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:47:58.585650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1045/2072] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:01.609109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120917b8-dc24-4111-88f2-04f53c15845b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:01.609718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120917b8-dc24-4111-88f2-04f53c15845b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:01.609718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120917b8-dc24-4111-88f2-04f53c15845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:01.631693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-120917b8-dc24-4111-88f2-04f53c15845b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:01.632912 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-120917b8-dc24-4111-88f2-04f53c15845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:01.641765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1028/2073] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:01.668154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:01.680792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283b67-7eae-4f11-a848-0e032a9c02bd service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:01.687577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:01.688179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:01.688456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:01.688729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:01.697434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:01.699045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:01.708868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1046/2074] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:04.798774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e31a-ac31-4875-bd8e-1c93a81f0b75 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:04.799656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e31a-ac31-4875-bd8e-1c93a81f0b75 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:04.799991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e31a-ac31-4875-bd8e-1c93a81f0b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:04.824431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2923e31a-ac31-4875-bd8e-1c93a81f0b75 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:04.825662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2923e31a-ac31-4875-bd8e-1c93a81f0b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:04.834854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1029/2075] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:04.860493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:04.872941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c87c8-82f3-4ed3-b337-99cf79ad66fc service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:04.879929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038092-ddba-463d-981f-04618d027fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:04.880636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038092-ddba-463d-981f-04618d027fcf service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:04.880943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038092-ddba-463d-981f-04618d027fcf service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:04.881212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038092-ddba-463d-981f-04618d027fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:04.889538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25038092-ddba-463d-981f-04618d027fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:04.891140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25038092-ddba-463d-981f-04618d027fcf service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:04.900701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1047/2076] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:10.116253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5e13-63fb-4e6c-961f-5b65ec0cf609 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:10.116825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5e13-63fb-4e6c-961f-5b65ec0cf609 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:10.117152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5e13-63fb-4e6c-961f-5b65ec0cf609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:10.144384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3c3d5e13-63fb-4e6c-961f-5b65ec0cf609 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:10.146737 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c3d5e13-63fb-4e6c-961f-5b65ec0cf609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:10.162177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1030/2077] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 17 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:10.189708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038092-ddba-463d-981f-04618d027fcf service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:10.202163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038092-ddba-463d-981f-04618d027fcf service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:10.210373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:10.212100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:10.212754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:10.213216 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:10.228377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:10.231700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:10.256486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1048/2078] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:14.894887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:14.895370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:14.895481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:14.916702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] MFA Rules not processed for user `bf24539086724dc4aa3d5c569a47e85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:14.917716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:14.975958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1031/2079] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:20.239373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=30 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:24.968466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=40 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:40.652904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:40.654467 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:40.668479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100a053-b2d8-427e-a1bf-f7432b11ea95 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:40.673274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:40.673944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:40.674226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:40.674498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] PATH_INFO: `/v3/users/e75484121670479f8dc59da8f216d8d8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:40.675614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75484121670479f8dc59da8f216d8d8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:40.677624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:40.734100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75484121670479f8dc59da8f216d8d8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:40.743819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75484121670479f8dc59da8f216d8d8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:40.756163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75484121670479f8dc59da8f216d8d8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:40.756841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75484121670479f8dc59da8f216d8d8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:40.764017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6a13ebc0-a7f0-46cc-986f-08d61fc16ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75484121670479f8dc59da8f216d8d8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:40.770054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1049/2080] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:48:40 2022] DELETE /identity/v3/users/e75484121670479f8dc59da8f216d8d8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:40.969852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:40.983124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623523-7c6a-4ac0-b654-c0ec4a989611 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.049532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.050280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.050560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.050829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] PATH_INFO: `/v3/projects/2d010c7efb6542528ddfc3c9e94d5f93` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.052299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d010c7efb6542528ddfc3c9e94d5f93)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.054290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.106053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d010c7efb6542528ddfc3c9e94d5f93', 'request_id': 'req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:41.115275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d010c7efb6542528ddfc3c9e94d5f93', 'request_id': 'req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:41.121718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d010c7efb6542528ddfc3c9e94d5f93', 'request_id': 'req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:41.134112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] The token cache is being invalidate because project 2d010c7efb6542528ddfc3c9e94d5f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:48:41.134407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:41.135319 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ab61fc88-08ea-4f4d-bd72-8a34428a7e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:41.137117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1032/2081] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:48:40 2022] DELETE /identity/v3/projects/2d010c7efb6542528ddfc3c9e94d5f93 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:41.142989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.143351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.143630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.164758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:41.166143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:41.232852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1050/2082] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:41.241161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.241494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.241777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.263216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:41.264585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:41.273103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1033/2083] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:41.277428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.288821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6abfb-b968-4ccd-a26e-9998f8ac10e2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.294224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.294884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.295329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.296298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.297001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:48:41.297296 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.298983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.315545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1051/2084] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:48:41.316704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.327473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d202cf7-54b4-47c4-b0cd-11f58da6b989 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.332911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.333761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.334024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.334295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.334956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.336924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.375324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1034/2085] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:48:41.377011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.394875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c74ec-bba5-4c33-ac93-b05dc8fbd9fc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.464635 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.465261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.465571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.465872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.466525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.468474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.477462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:41.495729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1052/2086] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:48:41 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:48:41.500220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.513879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3f73f-fc19-4ebb-850d-05567fdfef2c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.517992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.518973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.518973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.519202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.519847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.522249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.534695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1035/2087] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:48:41.538904 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.549357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11da6-867d-445d-b101-85d2fa18e253 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.554306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.554927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.555203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.555477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.556127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.557769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c272e9-f5da-4e25-a858-325dd730f160 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.570016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1053/2088] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:48:41.574561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.586195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463f5f0-b26e-4d30-9a6b-fa0da93c867b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.592017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.592837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.593114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.593381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] PATH_INFO: `/v3/projects/ed42902f443f49afa11c021fa64c6943/users/c4eced68406241059405addb8837844f/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.611047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed42902f443f49afa11c021fa64c6943, user_id=c4eced68406241059405addb8837844f, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.613927 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.638306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1036/2089] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:48:41 2022] PUT /identity/v3/projects/ed42902f443f49afa11c021fa64c6943/users/c4eced68406241059405addb8837844f/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:48:41.646187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.646594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.646878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.668127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:41.669523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:41.738603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1054/2090] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:41.748856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:41.750782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:41.786864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:41.817135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3904435-ddb4-4f9e-a3f5-f35204e8c143 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:41.821072 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:41.821682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:41.821989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:41.822253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:41.831481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:41.832975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:41.842680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1037/2091] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:42.727481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:42.729210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:42.743117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0bb24-f876-4baa-9665-b72e7fead1af None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:42.747199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:42.748377 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:42.748803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:42.749237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:42.751062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:42.892722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:42.894251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25969241-5026-4959-8924-ebedf12dcb57 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:42.926613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1055/2092] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:44.306620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:44.318964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964d5c6-24b9-476a-af7e-391c5bb80d41 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:44.324816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:44.325617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:44.326002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:44.326691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:44.328973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:44.349358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:44.351051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:44.364248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1038/2093] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:46.731203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:46.731744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:46.731744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:46.765033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] MFA Rules not processed for user `c4eced68406241059405addb8837844f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:46.766545 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:46.826461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:46.839786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1056/2094] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:46.844450 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:46.855585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2764671-15df-4dce-a9e9-f85b36d23383 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:46.860137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:46.860813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:46.861149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:46.861600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:46.862269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:46.864225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:46.894732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1039/2095] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:48:46 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:48:46.899833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:46.911303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b908-9aaf-4a26-a490-89c5761da612 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:46.979255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:46.979882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:46.980172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:46.981077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:46.981268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:46.983390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:47.010335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1057/2096] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:48:46 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:48:47.014301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:47.025262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5575c8-ca64-4b6a-bda8-30ac6d160095 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:47.030235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:47.031186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:47.031467 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:47.031738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:47.032539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:47.034219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:47.049419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1040/2097] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:48:47.054627 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:47.065259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8f6a-4ecf-476f-a161-cfc7ad823798 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:47.070821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:47.071570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:47.071940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:47.072281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] PATH_INFO: `/v3/projects/3f99d0144c41480d8a3db64e2d4b1617/users/5e1ee93f4f014fa7adeb8036ea24bdd7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:47.089805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f99d0144c41480d8a3db64e2d4b1617, user_id=5e1ee93f4f014fa7adeb8036ea24bdd7, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:47.092483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:47.109249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1058/2098] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:48:47 2022] PUT /identity/v3/projects/3f99d0144c41480d8a3db64e2d4b1617/users/5e1ee93f4f014fa7adeb8036ea24bdd7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:47.113211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:47.124113 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35e32d-1706-4b22-bee1-ef4d19935e64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:47.185630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:47.186260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:47.186542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:47.186816 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:47.187470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:47.189658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:47.204799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1041/2099] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:48:47.208867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:47.220485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e780-7ade-4c1c-a088-50f63ca5ed7d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:47.225768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:47.226484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:47.226722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:47.226996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] PATH_INFO: `/v3/projects/3f99d0144c41480d8a3db64e2d4b1617/users/5e1ee93f4f014fa7adeb8036ea24bdd7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:47.228917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f99d0144c41480d8a3db64e2d4b1617, user_id=5e1ee93f4f014fa7adeb8036ea24bdd7, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:47.231795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a75e-d6f1-435f-a051-b3b90152fd28 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:47.248100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1059/2100] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:48:47 2022] PUT /identity/v3/projects/3f99d0144c41480d8a3db64e2d4b1617/users/5e1ee93f4f014fa7adeb8036ea24bdd7/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:48:49.794266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:49.869427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0cce7-97c7-45fd-820e-2f70bcec9a35 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:49.952473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:49.984223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:49.985151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:49.985703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:49.986192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:49.988301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:50.088872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:50.091309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:50.108209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1042/2101] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:52.984839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:52.997521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:52.997521 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:53.052942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] MFA Rules not processed for user `5e1ee93f4f014fa7adeb8036ea24bdd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:53.054987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:53.188270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1060/2102] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:53.208091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:53.211074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:53.343033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fdd5-860e-490d-b252-584020412bda service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:53.352073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:53.352977 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:53.354412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:53.354865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:53.461806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:53.464478 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd54753-5b32-475a-a820-06552e7010d5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:53.478561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1043/2103] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:55.299529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:55.301807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:55.318305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b949d-ef20-4606-a146-0099d87601f2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:55.323834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:55.324878 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:55.325334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:55.325622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] PATH_INFO: `/v3/users/56dbff833b7f452a839852b02fb18672` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:55.327134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dbff833b7f452a839852b02fb18672)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:55.329560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:55.367349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:55.400920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dbff833b7f452a839852b02fb18672'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.415294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dbff833b7f452a839852b02fb18672'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.435941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dbff833b7f452a839852b02fb18672'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.436853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dbff833b7f452a839852b02fb18672'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.447698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dbff833b7f452a839852b02fb18672'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.467369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1061/2104] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:48:55 2022] DELETE /identity/v3/users/56dbff833b7f452a839852b02fb18672 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:55.475919 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819584-4c30-4e08-bbb0-a030c0ded79a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:55.476481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819584-4c30-4e08-bbb0-a030c0ded79a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:55.476576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819584-4c30-4e08-bbb0-a030c0ded79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:55.512944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4f819584-4c30-4e08-bbb0-a030c0ded79a None None] MFA Rules not processed for user `c4eced68406241059405addb8837844f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:55.514211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f819584-4c30-4e08-bbb0-a030c0ded79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:55.539993 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:55.591753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1044/2105] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:55.705867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:55.707681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:55.804549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94506f-ede7-4b20-9573-27156e1b275a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:55.810186 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:55.810813 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:55.811092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:55.811364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] PATH_INFO: `/v3/projects/2339fbb287cb41adbfb272868d82c8f0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:55.812506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2339fbb287cb41adbfb272868d82c8f0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:55.814446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:55.881511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2339fbb287cb41adbfb272868d82c8f0', 'request_id': 'req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.889899 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2339fbb287cb41adbfb272868d82c8f0', 'request_id': 'req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.897217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2339fbb287cb41adbfb272868d82c8f0', 'request_id': 'req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.911261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] The token cache is being invalidate because project 2339fbb287cb41adbfb272868d82c8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:48:55.911261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.911261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-79f967bd-d86f-4f25-b6cb-01635c5b6c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:48:55.912945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1062/2106] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:48:55 2022] DELETE /identity/v3/projects/2339fbb287cb41adbfb272868d82c8f0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:55.918596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:55.919106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:55.919426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:55.942728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:55.943917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:56.021333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1045/2107] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:56.032025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.032418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.032837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.062501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:56.063674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:56.076217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1063/2108] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:48:56.080543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.093048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70570fa-4107-479c-a390-805e4aa438b8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.104163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.104932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.105690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.106207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.107134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:48:56.107507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.109221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.124097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1046/2109] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:48:56.130696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.142376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9433-80fb-4a96-a54c-ab22d9170902 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.149348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.150042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.150329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.150598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.151263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.153358 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.191018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1064/2110] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:48:56 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:48:56.195358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.206057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afa2ab-bc5c-4ce1-b3d7-caacca508ea4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.271230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.272019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.272746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.273073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.274048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.276320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.306399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1047/2111] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:48:56 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:48:56.310257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.320751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:56.328243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d82e-9655-4c4a-bdcc-c6cde83acf8b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.341214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.342115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.342495 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.342864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.343624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.345881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.361084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1065/2112] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:48:56.362847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.377443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7aa90-b8b3-465b-8e6c-192c07ca257a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.382778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.383398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.383671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.385624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.385624 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.386972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b887-e68a-41fc-900b-5e147bedee45 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.399231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1048/2113] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:48:56.403244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.414539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717143d-de8a-4b24-9462-e2346e346c16 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.418304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.418963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.419238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.419512 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] PATH_INFO: `/v3/projects/528b3c2e26aa40b69478117d03bac593/users/f219f407ca1b4ac6b86bc0f240a335e4/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.435668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528b3c2e26aa40b69478117d03bac593, user_id=f219f407ca1b4ac6b86bc0f240a335e4, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.438842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.454780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1066/2114] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:48:56 2022] PUT /identity/v3/projects/528b3c2e26aa40b69478117d03bac593/users/f219f407ca1b4ac6b86bc0f240a335e4/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:48:56.465711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.465711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.465711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.500691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] MFA Rules not processed for user `f219f407ca1b4ac6b86bc0f240a335e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:48:56.502176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:56.532521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:56.608585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1049/2115] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:48:56.621222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:56.623288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:56.707013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b120a8-5841-40c5-b431-5fe3e78af141 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:56.713229 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:56.713897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:56.714177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:56.714454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:56.725212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:56.726941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076735a-5ee0-44a2-8bce-4979791dba77 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:56.738392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1067/2116] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:48:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:48:57.782632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:48:57.784514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:57.853243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca674-ade2-4eb0-8fc5-47c35040cb06 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:48:57.857496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:48:57.858147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:48:57.858428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:48:57.858752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:48:57.861064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:48:57.936471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:48:57.938946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:48:57.954106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1050/2117] 10.222.0.62 () {60 vars in 1396 bytes} [Mon Oct 17 17:48:57 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:49:00.026313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:00.026835 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:00.026916 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:00.048743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:00.050363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:00.109729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1068/2118] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:00.164825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:00.166822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:00.250640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef5dbd-1fbc-4e19-af20-d98264aed737 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:00.257658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:00.259311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:00.259865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:00.260329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:00.272346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:00.274007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de89230-0d55-4b03-aaaa-f9e4eb9d1ccb service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:00.283011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1051/2119] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:49:02.279603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:02.359713 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d4d1-cf98-4c8f-9457-0ba17c54c218 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:02.366908 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:02.368050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:02.368555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:02.368977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] PATH_INFO: `/v3/users/f219f407ca1b4ac6b86bc0f240a335e4` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:02.371608 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f219f407ca1b4ac6b86bc0f240a335e4)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:02.374039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:02.377870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:02.455385 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f219f407ca1b4ac6b86bc0f240a335e4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:02.466831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f219f407ca1b4ac6b86bc0f240a335e4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:02.489063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f219f407ca1b4ac6b86bc0f240a335e4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:02.490193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f219f407ca1b4ac6b86bc0f240a335e4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:02.499307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f219f407ca1b4ac6b86bc0f240a335e4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:02.506677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1069/2120] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:02 2022] DELETE /identity/v3/users/f219f407ca1b4ac6b86bc0f240a335e4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:02.512095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:02.513103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:02.513621 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:02.550411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:02.560834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:02.562393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:02.641732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1052/2121] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:02.652621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:02.654233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:02.732801 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f60929-49e9-4888-9cfe-1f68cbec29b5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:02.736662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:02.737369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:02.737791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:02.738130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:02.750765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:02.752402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570abaa-1966-486a-8d08-bb51db6c2b95 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:02.764011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1070/2122] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:49:03.180777 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.206901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:03.221400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28656d90-bcd6-4dd4-ae89-20f243ac29a4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.226955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.227674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.227957 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.228226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] PATH_INFO: `/v3/projects/528b3c2e26aa40b69478117d03bac593` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.231878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528b3c2e26aa40b69478117d03bac593)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.234418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.296974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528b3c2e26aa40b69478117d03bac593', 'request_id': 'req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:03.306819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528b3c2e26aa40b69478117d03bac593', 'request_id': 'req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:03.313818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528b3c2e26aa40b69478117d03bac593', 'request_id': 'req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:03.327453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] The token cache is being invalidate because project 528b3c2e26aa40b69478117d03bac593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:03.327755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:03.328474 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8a7273d5-03f1-4eb3-9912-0c93bf1e29a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:03.330521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1053/2123] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:03 2022] DELETE /identity/v3/projects/528b3c2e26aa40b69478117d03bac593 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:03.336125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.336689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.336794 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.386959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:03.386959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:03.463459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1071/2124] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:49:03.474040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.474738 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.475384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.519150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:03.520438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:03.528965 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1054/2125] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:03.533626 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.544759 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92719603-0b35-4bd9-a70a-13ac2de0abe2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.549544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.550280 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.550583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.551084 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.551744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:03.552043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.553682 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.568922 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1072/2126] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:49:03.573209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.591786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81a03-c243-411c-b54b-a53cd5f7dfd6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.615229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.616191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.616514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.616760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.619385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.623181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.678641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1055/2127] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:03 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:03.683643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.700036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf628f-8db0-4942-9f3f-f23e72d9c322 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.706934 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:03.784536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.785716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.786055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.786382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.787346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.790330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.824528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1073/2128] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:03 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:03.828987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.842771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6a1c-062b-40ae-979c-0e855b47befc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.849330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.850147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.850493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.850924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.851743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.854309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.898981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1056/2129] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:03.903088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.917326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b3e-affe-41db-b6c6-39129e99682b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.926389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.927889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.928496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.929018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.929841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:03.931999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34824b-04a7-497e-9f8c-39545b2de29a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:03.946642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1074/2130] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:49:03.951150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:03.967579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0ecc3-6b18-4c89-bbb4-f9f0fe98bc3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:03.976839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:03.977619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:03.977898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:03.978172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] PATH_INFO: `/v3/projects/98e6c703b42748ceb665250b088af8c3/users/8a44a7b2eeef4f2e9417b688702635e0/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:03.998449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e6c703b42748ceb665250b088af8c3, user_id=8a44a7b2eeef4f2e9417b688702635e0, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:04.001878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:04.033725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1057/2131] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:03 2022] PUT /identity/v3/projects/98e6c703b42748ceb665250b088af8c3/users/8a44a7b2eeef4f2e9417b688702635e0/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:49:04.035594 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:04.036073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:04.036354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:04.112638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] MFA Rules not processed for user `8a44a7b2eeef4f2e9417b688702635e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:04.116011 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:04.278750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1075/2132] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:04.290399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:04.292240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:04.334623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:04.452519 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ba4-d53c-4e4e-ae7a-3c699f99b924 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:04.465800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:04.466459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:04.466776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:04.467046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:04.476732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:04.479416 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f08607-7f6a-431c-aa64-1928eb4ab713 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:04.513557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1058/2133] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:49:07.420601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:07.527090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfafb0c-f330-4568-8ca6-c16b403a5d40 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:07.536911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:07.538234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:07.538698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:07.539476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] PATH_INFO: `/v3/users/8a44a7b2eeef4f2e9417b688702635e0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:07.541129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a44a7b2eeef4f2e9417b688702635e0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:07.545319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:07.582107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:07.623785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a44a7b2eeef4f2e9417b688702635e0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:07.634940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a44a7b2eeef4f2e9417b688702635e0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:07.653642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a44a7b2eeef4f2e9417b688702635e0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:07.658308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a44a7b2eeef4f2e9417b688702635e0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:07.669328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a44a7b2eeef4f2e9417b688702635e0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:07.678689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1076/2134] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:07 2022] DELETE /identity/v3/users/8a44a7b2eeef4f2e9417b688702635e0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:07.684052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:07.684571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:07.684670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:07.714829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:07.717214 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:07.794647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1059/2135] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:07.805549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:07.807491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:07.891103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeed03-28f3-402c-b658-2394703dff67 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:07.895983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:07.896800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:07.897220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:07.897642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:07.910199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:07.913151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2791e-61e2-4acf-a82f-daabf1dcd4d9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:07.958431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1077/2136] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:08.391514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:08.394193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:08.408824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e9ad-610f-4502-9c45-b9508a1b8a6b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:08.415311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:08.415971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.416255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.416607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] PATH_INFO: `/v3/projects/98e6c703b42748ceb665250b088af8c3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.418096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e6c703b42748ceb665250b088af8c3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:08.420454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:08.477521 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e6c703b42748ceb665250b088af8c3', 'request_id': 'req-3993868f-0d31-4095-aacd-9e41b46607d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:08.487866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e6c703b42748ceb665250b088af8c3', 'request_id': 'req-3993868f-0d31-4095-aacd-9e41b46607d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:08.497149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e6c703b42748ceb665250b088af8c3', 'request_id': 'req-3993868f-0d31-4095-aacd-9e41b46607d8'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:08.515163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] The token cache is being invalidate because project 98e6c703b42748ceb665250b088af8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:08.515532 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:08.516185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3993868f-0d31-4095-aacd-9e41b46607d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:08.517833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1060/2137] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:08 2022] DELETE /identity/v3/projects/98e6c703b42748ceb665250b088af8c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:08.523146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.523616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.523754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.556226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:08.557811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:08.637662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1078/2138] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:08.643365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.643731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.644570 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.675339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:08.676612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:08.686518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1061/2139] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:08.691549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:08.705918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42669-845d-4547-ad69-199bb9e732f8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:08.712279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:08.712902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.713171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.713436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.714165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:08.714540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:08.716255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:08.733644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1079/2140] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:49:08.735806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:08.747215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5ef2e-5e11-42d2-915e-114d331ea5f2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:08.758205 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:08.759150 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.759438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.759708 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.760404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:08.762431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:08.797623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1062/2141] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:08 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:08.799126 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:08.809876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba82d-964a-42b2-9598-555c5b49be04 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:08.836284 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:08.878265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:08.879191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.879657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.880092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.880884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:08.882995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:08.915175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1080/2142] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:08 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:08.920958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:08.932768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151db05-d113-4e2a-bdfd-e420c8dbe4c2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:08.944013 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:08.944628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:08.944910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:08.945175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:08.945864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:08.947473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:08.948998 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:08.968382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1063/2143] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:49:08.974277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:09.001175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988015-e27f-474d-839c-d319d4684638 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:09.008511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:09.009465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:09.009873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:09.010357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:09.011136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:09.012892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:09.030560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:09.032597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:09.046161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1081/2144] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:09.056342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:09.071764 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1d14-ded9-45ba-807a-4a98d688161b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:09.080275 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:09.082151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:09.082670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:09.083088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] PATH_INFO: `/v3/projects/7d7d22e3a0b44c9d9df162c191787482/users/7cdd27f1cb764847b3acd85afb61deb1/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:09.108804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7d22e3a0b44c9d9df162c191787482, user_id=7cdd27f1cb764847b3acd85afb61deb1, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:09.114159 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161e93e-16c1-493f-8b8c-bcc0d0cd7097 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:09.136680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1082/2145] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:09 2022] PUT /identity/v3/projects/7d7d22e3a0b44c9d9df162c191787482/users/7cdd27f1cb764847b3acd85afb61deb1/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:49:09.147572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceea37-8295-4835-a109-509e360c945c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:09.148330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceea37-8295-4835-a109-509e360c945c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:09.148330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceea37-8295-4835-a109-509e360c945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:09.187050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4acb-44f6-4094-99a8-50233a34cc58 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:09.192370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a7ceea37-8295-4835-a109-509e360c945c None None] MFA Rules not processed for user `7cdd27f1cb764847b3acd85afb61deb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:09.194669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a7ceea37-8295-4835-a109-509e360c945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:09.282940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:09.283612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:09.283887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:09.284153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:09.295119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:09.357051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1083/2146] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:09.383315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceea37-8295-4835-a109-509e360c945c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:09.385319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a7ceea37-8295-4835-a109-509e360c945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:09.437273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:09.439699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:09.451929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1064/2147] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:09.528949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceea37-8295-4835-a109-509e360c945c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:09.532640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:09.533254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:09.533528 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:09.533854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:09.546426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:09.547883 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:09.559133 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1084/2148] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:11.165292 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:11.166959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:11.208341 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:11.251566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3b4a-884c-42f3-a6d6-83545c054fd6 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:11.255799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:11.256688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:11.256974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:11.257246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:11.259357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:11.272142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:11.273740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:11.283464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1065/2149] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:12.620992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:12.622653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:12.635588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc535a0-488d-497b-8c3d-ac7b26a76044 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:12.644430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:12.644430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:12.644430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:12.644430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:12.646353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:12.658649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:12.660255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fbdb2-8c2f-4951-8168-661b549e4d76 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:12.664849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:12.670928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1085/2150] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:13.170803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:13.175453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:13.251470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae91f-de97-45d2-95fe-7eedbc43fc05 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:13.257011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:13.257745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:13.258024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:13.258294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:13.260243 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:13.272550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:13.274192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24336a-468c-4b5f-9cd4-6865a8445b80 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:13.284683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1066/2151] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:15.729485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:15.730103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:15.730103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:15.731699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1086/2152] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:49:15.739732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066238-9a53-4613-a835-a55d1cd5a15d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:15.740736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066238-9a53-4613-a835-a55d1cd5a15d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:15.741314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066238-9a53-4613-a835-a55d1cd5a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:15.764436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7b066238-9a53-4613-a835-a55d1cd5a15d None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:15.765697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7b066238-9a53-4613-a835-a55d1cd5a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:15.776520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1067/2153] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:49:15.789509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:15.792227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:15.881231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf716e58-d1d3-40e9-8a05-92f2f0116f85 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:15.886039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:15.886719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:15.887001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:15.887331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:15.908436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:15.910356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5d9e-f06f-4cc2-8a59-bf38ce340d70 service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:15.922390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1087/2154] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:16.010815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7904-00d0-4fd5-8a75-5f0d4fab71c0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.011304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7904-00d0-4fd5-8a75-5f0d4fab71c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.011695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7904-00d0-4fd5-8a75-5f0d4fab71c0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.013301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1068/2155] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:49:16.019727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4227c-9880-4861-80f6-1598efe0c86a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.020231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4227c-9880-4861-80f6-1598efe0c86a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.020650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4227c-9880-4861-80f6-1598efe0c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.045872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d8c4227c-9880-4861-80f6-1598efe0c86a None None] MFA Rules not processed for user `9d909083488f4a8c9ef7bd628c801950`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:16.047152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d8c4227c-9880-4861-80f6-1598efe0c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:16.054807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1088/2156] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:49:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:16.069018 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7904-00d0-4fd5-8a75-5f0d4fab71c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:16.080856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7904-00d0-4fd5-8a75-5f0d4fab71c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:16.084731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:16.085345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.085654 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.085948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.094378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:16.097799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5d25-32c3-4639-abbc-5ab4e79c4f4c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:16.106775 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1069/2157] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:16.197572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76700bdd-f36a-4eb4-9181-e4a6e7fb008b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.197767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76700bdd-f36a-4eb4-9181-e4a6e7fb008b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.198051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76700bdd-f36a-4eb4-9181-e4a6e7fb008b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.199443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1089/2158] 10.222.0.62 () {54 vars in 921 bytes} [Mon Oct 17 17:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 17:49:16.205057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a622-0799-4767-b078-00426a95d864 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.205595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a622-0799-4767-b078-00426a95d864 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.205959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a622-0799-4767-b078-00426a95d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.227041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-28c5a622-0799-4767-b078-00426a95d864 None None] MFA Rules not processed for user `dd4de9ba564044ab8a8f835faae23ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:16.229088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28c5a622-0799-4767-b078-00426a95d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:16.240121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1070/2159] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Oct 17 17:49:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:16.251803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76700bdd-f36a-4eb4-9181-e4a6e7fb008b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:16.265487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76700bdd-f36a-4eb4-9181-e4a6e7fb008b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:16.270263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:16.270971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:16.271344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:16.271689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:16.285739 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:16.287262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061b41-b90b-4f8a-9ffc-bc2eae68fbfc service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:16.299901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1090/2160] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:18.793609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a622-0799-4767-b078-00426a95d864 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:18.873914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a622-0799-4767-b078-00426a95d864 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:18.880572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:18.881236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:18.881487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:18.881934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] PATH_INFO: `/v3/users/7cdd27f1cb764847b3acd85afb61deb1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:18.882973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdd27f1cb764847b3acd85afb61deb1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:18.885144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:18.943747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:18.951996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdd27f1cb764847b3acd85afb61deb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:18.953203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdd27f1cb764847b3acd85afb61deb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:18.962759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdd27f1cb764847b3acd85afb61deb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:18.981702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdd27f1cb764847b3acd85afb61deb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:18.990623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdd27f1cb764847b3acd85afb61deb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:18.996954 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1071/2161] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:18 2022] DELETE /identity/v3/users/7cdd27f1cb764847b3acd85afb61deb1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:19.001553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:19.002111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:19.002111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:19.029523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:19.031192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:19.120375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1091/2162] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:49:19.135456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:19.140946 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:19.242515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1817-121f-4d73-92c5-8e245f5a91aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:19.250063 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:19.250671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:19.250953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:19.251230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:19.262696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:19.264131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82589465-dd4e-4026-935f-6da69c9db44a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:19.278111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1072/2163] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:19.706843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:19.708641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:19.722352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754208-c70d-4f31-82be-cd1c519f69d1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:19.729104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:19.730179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:19.730742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:19.731252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] PATH_INFO: `/v3/projects/7d7d22e3a0b44c9d9df162c191787482` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:19.732488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7d22e3a0b44c9d9df162c191787482)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:19.735008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:19.797436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7d22e3a0b44c9d9df162c191787482', 'request_id': 'req-fa604a22-1e51-4a05-8b3e-f02725584c95'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:19.807737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7d22e3a0b44c9d9df162c191787482', 'request_id': 'req-fa604a22-1e51-4a05-8b3e-f02725584c95'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:19.814680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7d22e3a0b44c9d9df162c191787482', 'request_id': 'req-fa604a22-1e51-4a05-8b3e-f02725584c95'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:19.827430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] The token cache is being invalidate because project 7d7d22e3a0b44c9d9df162c191787482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:19.827717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:19.828459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fa604a22-1e51-4a05-8b3e-f02725584c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:19.830235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1092/2164] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:19 2022] DELETE /identity/v3/projects/7d7d22e3a0b44c9d9df162c191787482 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:19.838513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:19.839295 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:19.839490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:19.861281 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:19.862541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:19.928715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1073/2165] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:19.937237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:19.937633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:19.937995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:19.960134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:19.967455 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:19.969425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:19.980000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1093/2166] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:19.984585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:19.995368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f476d-95eb-4799-96a8-c683d3d912de None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.000267 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.000881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.001153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.001402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.002083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:20.002385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.004038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.016148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1074/2167] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:49:20.021144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.031168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc183d-b663-4208-b470-669c5db98b38 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.037446 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.038168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.038465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.038810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.039473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.041420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.076318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1094/2168] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:20.082844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.093789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88092-98e6-448e-a320-28a254c94a0b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.143828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:20.162099 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.162733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.162994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.163257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.163891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.165862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.189941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1075/2169] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:20.194356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.205051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25391ef5-9364-4a70-9bfe-343b2892c921 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.210143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.210748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.211025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.211507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.211945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.213539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.224789 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1095/2170] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:20.229415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.244041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d769-1f36-4b68-9612-2a1fe5651b44 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.250171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.250769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.251041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.251297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.251934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.253551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2a4a7-8d09-4e73-8f24-fce3f8c6be5f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.268406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1076/2171] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:20.273116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.283599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8bd3f-e898-47c9-8574-f2471b02b21d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.289262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.289973 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.290246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.290511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] PATH_INFO: `/v3/projects/8dc7b2b0bd4043faacac707e680cf9fc/users/900b85bca2fa448ab6a828b58ef58974/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.307321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc7b2b0bd4043faacac707e680cf9fc, user_id=900b85bca2fa448ab6a828b58ef58974, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.310030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5ea28-ebde-415d-86a3-05d724a88bbc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.328300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1096/2172] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:20 2022] PUT /identity/v3/projects/8dc7b2b0bd4043faacac707e680cf9fc/users/900b85bca2fa448ab6a828b58ef58974/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:20.340301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.340582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.340858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.372050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] MFA Rules not processed for user `900b85bca2fa448ab6a828b58ef58974`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:20.373259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:20.457302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.457624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.457919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.466107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1077/2173] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:20.470817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.481171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:20.483200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:20.557190 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1097/2174] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:20.557915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808910f-9b57-493a-b33a-28cb6b2af759 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.564237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.565023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.565903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.566432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.567162 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.569703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.571726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.573478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:20.604030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1078/2175] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:49:20.605007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.659796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92381-ea77-41b7-b6b1-3fd593c7aec7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.665531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:20.695713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594ed9-e233-4ea3-9b08-d96b9a7f369a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.701491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.702743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.703025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.703296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.703950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.706141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.722329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:20.741642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1079/2176] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:20 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:49:20.744477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.744890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.745381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.745762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.746006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.756325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d518db-689b-4f58-8807-ee65c1c191be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.761814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.762769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.763052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.763318 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.763974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.765649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.778496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1080/2177] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:20.782882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.793255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5c10-7827-4317-8d59-34f4aa554ab0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.802232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.802940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.803225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.803821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] PATH_INFO: `/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f/users/621ab442ccd849edba09440582de8ec6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.829550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a5a7b17db14ad3bee7381fd9ad6f6f, user_id=621ab442ccd849edba09440582de8ec6, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.834170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.838525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.840450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.851397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1098/2178] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 17:49:20.854572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1081/2179] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:20 2022] PUT /identity/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f/users/621ab442ccd849edba09440582de8ec6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:49:20.858520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.877213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299de3-184e-4dd1-879f-fba67552e482 service swift] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.962060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.963009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.963363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.963754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:20.964477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:20.966336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bb52c-7d25-40c9-95fb-482615cc5d40 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:20.978085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1099/2180] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:20.982254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:20.993809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433f0e-c301-430f-987a-0f6f64536f60 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:20.998539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:20.999202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:20.999482 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:20.999756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] PATH_INFO: `/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f/users/621ab442ccd849edba09440582de8ec6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:21.001827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a5a7b17db14ad3bee7381fd9ad6f6f, user_id=621ab442ccd849edba09440582de8ec6, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:21.005455 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:21.019076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1082/2181] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:20 2022] PUT /identity/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f/users/621ab442ccd849edba09440582de8ec6/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:21.032754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:21.033672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:21.034155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:21.069950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] MFA Rules not processed for user `621ab442ccd849edba09440582de8ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:21.071177 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:21.146088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1100/2182] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:21.158056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:21.160224 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:21.274048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890f74-fd3c-4cac-bd8e-99d71577594d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:21.278456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:21.279358 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:21.279759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:21.280110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:21.292433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:21.296709 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd394e-3965-456d-b719-52d1a7427996 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:21.310410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1083/2183] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:21.485076 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:21.513872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:21.582136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e7a9-29b3-43b6-85cb-3136ccdb961c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:21.586757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:21.587529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:21.587807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:21.588086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] PATH_INFO: `/v3/users/900b85bca2fa448ab6a828b58ef58974` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:21.589273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=900b85bca2fa448ab6a828b58ef58974)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:21.591299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:21.696587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900b85bca2fa448ab6a828b58ef58974'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:21.718634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900b85bca2fa448ab6a828b58ef58974'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:21.736157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900b85bca2fa448ab6a828b58ef58974'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:21.736894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900b85bca2fa448ab6a828b58ef58974'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:21.745787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900b85bca2fa448ab6a828b58ef58974'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:21.760260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1101/2184] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:21 2022] DELETE /identity/v3/users/900b85bca2fa448ab6a828b58ef58974 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:21.765971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:21.766258 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:21.766539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:21.804037 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:21.805291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:21.879991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1084/2185] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:21.890559 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:21.892157 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:21.978621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4671a8-eeaf-458b-8e1f-81d7d9e706ba admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:21.982449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:21.983281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:21.983486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:21.983817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:22.020263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:22.021876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:22.043368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1102/2186] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:22.452234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:22.452234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:22.471176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a803a0-c580-4267-9959-ca8cc58993d5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:22.479419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:22.480659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:22.480659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:22.481108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] PATH_INFO: `/v3/projects/8dc7b2b0bd4043faacac707e680cf9fc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:22.482543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc7b2b0bd4043faacac707e680cf9fc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:22.484721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:22.514166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:22.561956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc7b2b0bd4043faacac707e680cf9fc', 'request_id': 'req-dc50d625-6895-4f27-ae2a-0ed82d8832c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.577049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc7b2b0bd4043faacac707e680cf9fc', 'request_id': 'req-dc50d625-6895-4f27-ae2a-0ed82d8832c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.591864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc7b2b0bd4043faacac707e680cf9fc', 'request_id': 'req-dc50d625-6895-4f27-ae2a-0ed82d8832c3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.610768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] The token cache is being invalidate because project 8dc7b2b0bd4043faacac707e680cf9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:22.611509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.612852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.615799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1085/2187] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:22 2022] DELETE /identity/v3/projects/8dc7b2b0bd4043faacac707e680cf9fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:22.619920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:22.635755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a3390-4276-4ad7-9564-b91922488534 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:22.699408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:22.728183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:22.728925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:22.729260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:22.729628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] PATH_INFO: `/v3/users/621ab442ccd849edba09440582de8ec6` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:22.731334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621ab442ccd849edba09440582de8ec6)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:22.733241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:22.828975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621ab442ccd849edba09440582de8ec6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.844554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621ab442ccd849edba09440582de8ec6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.863766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621ab442ccd849edba09440582de8ec6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.868935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621ab442ccd849edba09440582de8ec6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.880697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b3afe30c-a2b8-4a51-be13-6839020530a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621ab442ccd849edba09440582de8ec6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:22.888897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1103/2188] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:22 2022] DELETE /identity/v3/users/621ab442ccd849edba09440582de8ec6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:23.323867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:23.325404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:23.340015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d625-6895-4f27-ae2a-0ed82d8832c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:23.417429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:23.418108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.418390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.418662 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] PATH_INFO: `/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.419834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a5a7b17db14ad3bee7381fd9ad6f6f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:23.421801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:23.506216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a5a7b17db14ad3bee7381fd9ad6f6f', 'request_id': 'req-b26691ea-712e-42bc-9518-053ad92f72e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:23.520697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a5a7b17db14ad3bee7381fd9ad6f6f', 'request_id': 'req-b26691ea-712e-42bc-9518-053ad92f72e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:23.532985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a5a7b17db14ad3bee7381fd9ad6f6f', 'request_id': 'req-b26691ea-712e-42bc-9518-053ad92f72e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:23.549375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] The token cache is being invalidate because project 56a5a7b17db14ad3bee7381fd9ad6f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:23.549844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:23.550527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b26691ea-712e-42bc-9518-053ad92f72e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:23.552175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1086/2189] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:23 2022] DELETE /identity/v3/projects/56a5a7b17db14ad3bee7381fd9ad6f6f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:23.557154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.557722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.557822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.583052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:23.584330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:23.685221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1104/2190] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:23.694085 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.694418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.694881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.718531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:23.719791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:23.728403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1087/2191] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:23.732790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:23.743867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1444c-4dda-4785-8000-f78e6ed57b43 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:23.748808 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:23.749428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.749735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.750010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.750663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:23.750963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:23.752832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:23.765564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1105/2192] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:49:23.771623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:23.782144 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfa134-6f69-4e0b-bbb4-896e4a3a09e0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:23.788728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:23.789378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.789698 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.789945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.790587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:23.792565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:23.835855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:23.836823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1088/2193] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:23 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:23.844660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa687-08b0-4cbc-91dc-6befef4b404c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:23.895966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:23.918641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:23.919260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.919533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.921871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.923131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:23.925188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:23.953271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1106/2194] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:23 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:49:23.957861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:23.969916 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8e-92e0-4618-884f-8b66759e766c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:23.980149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:23.980937 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:23.981016 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:23.981329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:23.981964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:23.983605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:23.986216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:24.007659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1089/2195] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:24.007941 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.038611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e44a-a131-4b14-95bf-5eed2ecafc7a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.052952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.053614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.053903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.054179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.054960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.056674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00246038-e70f-4bd2-8f72-5e7421d195af admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.084518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1107/2196] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:24.086772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.109869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c770fb-999f-41a5-8688-f4a0a67c7446 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.121046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.122364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.122743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.123109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] PATH_INFO: `/v3/projects/7cf25cde913b4e74ba9b7198aad4a6ba/users/8fbdd7c186914052941d3f2e06df563b/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.150682 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf25cde913b4e74ba9b7198aad4a6ba, user_id=8fbdd7c186914052941d3f2e06df563b, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.155063 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.209634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1090/2197] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:24 2022] PUT /identity/v3/projects/7cf25cde913b4e74ba9b7198aad4a6ba/users/8fbdd7c186914052941d3f2e06df563b/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:24.217491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.217831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.218208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.255610 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] MFA Rules not processed for user `8fbdd7c186914052941d3f2e06df563b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:24.257055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:24.383697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1108/2198] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:24.385141 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.507111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba9c7-0071-4cda-9c5d-3312fb5207d6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.514167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.514881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.515159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.515502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.516457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.519719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.561687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1091/2199] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:24 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:24.563428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.579625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da98e-e51e-4183-aec5-1624d0c69dba None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.677175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.677842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.678105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.678403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.679054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.681061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.710300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1109/2200] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:24 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:24.714548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.726010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce53791-ad51-49ce-8156-3e58e681eee3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.730943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.731556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.731832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.732104 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.732751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.734410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.746493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1092/2201] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:24.750951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.766015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7d4d8-fa3c-41fb-8435-d457569de5a3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.771108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.771698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.771976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.772260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.772907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.774541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be0f9d-9913-4ed3-b78b-9774e36d9c54 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.785340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1110/2202] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:24.790926 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:24.801075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8907571-1c90-4144-8ff7-2a5a80ab4a91 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:24.806045 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:24.806732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.807024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.807289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] PATH_INFO: `/v3/projects/5f67df7a84fa42e289756e2118e7e074/users/491a11b33d34468f89d9ac94ebe27177/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.824609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f67df7a84fa42e289756e2118e7e074, user_id=491a11b33d34468f89d9ac94ebe27177, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:24.828122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:24.850414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1093/2203] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:24 2022] PUT /identity/v3/projects/5f67df7a84fa42e289756e2118e7e074/users/491a11b33d34468f89d9ac94ebe27177/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:24.860994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:24.861281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:24.861568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:24.897302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] MFA Rules not processed for user `491a11b33d34468f89d9ac94ebe27177`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:24.898645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:24.919348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:24.980279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1111/2204] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:24.985009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.062129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512fbbe-f985-4e57-8b1a-0671c944206a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.067397 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.068002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.068279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.068552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.069190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.071233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.109798 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1094/2205] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:24 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:25.111112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.124172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e684-350e-43a7-9d0d-24ab2fcc23d6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.198075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.198849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.199132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.199411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.200077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.202199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.243826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1112/2206] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:25 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:49:25.250826 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.262022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd67e-0689-45c0-b6c5-94a316cdf803 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.267673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.269221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.269626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.269952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.270804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.272936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.276241 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:25.288529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1095/2207] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:25.293288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.305840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ba62b-0143-4c2c-9b21-222d63d47515 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.312580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.313596 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.314088 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.315645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] PATH_INFO: `/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3/users/9319e70c37944eed894b7038b05d08e8/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.332833 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb6fb4c7b254268aa89919fa31df2f3, user_id=9319e70c37944eed894b7038b05d08e8, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.335729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.373143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1113/2208] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:25 2022] PUT /identity/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3/users/9319e70c37944eed894b7038b05d08e8/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:25.377119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.393111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f061b-5421-4781-8271-92c3ba37f957 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.502020 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.502786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.503111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.503387 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.504041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.505695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d02d2a-cc09-484b-a0f4-bd904f89e26f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.516395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1096/2209] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:25.520747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.531790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f870ad-ccdb-4535-a45e-439191cadb2c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.537524 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.538232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.538511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.538785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] PATH_INFO: `/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3/users/9319e70c37944eed894b7038b05d08e8/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.540731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb6fb4c7b254268aa89919fa31df2f3, user_id=9319e70c37944eed894b7038b05d08e8, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.543532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.555670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1114/2210] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:25 2022] PUT /identity/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3/users/9319e70c37944eed894b7038b05d08e8/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:25.571920 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.572502 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.573247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.640353 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] MFA Rules not processed for user `9319e70c37944eed894b7038b05d08e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:25.641948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:25.738900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1097/2211] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:25.751845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.754402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:25.841969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ff09-ed5a-4075-9adb-0c2ce0dfdb2a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.850582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.851719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.852112 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.852737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:25.868584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:25.869369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:25.881327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1115/2212] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:25.939697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:25.941334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:25.953891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c840-e45e-4155-bba4-835ab8893f21 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:25.957986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:25.958706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:25.959050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:25.959368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:26.035823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:26.037290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a9471-b8b1-4740-ad7b-4f81b3c25251 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:26.047566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1098/2213] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:49:29.314613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:29.362780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:29.497242 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a4347-1ad7-43cc-8413-457d4a108ffa service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:29.503942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:29.504614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:29.504893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:29.505171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] PATH_INFO: `/v3/users/8fbdd7c186914052941d3f2e06df563b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:29.507252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbdd7c186914052941d3f2e06df563b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:29.513744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:29.637252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbdd7c186914052941d3f2e06df563b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:29.677954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbdd7c186914052941d3f2e06df563b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:29.732544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbdd7c186914052941d3f2e06df563b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:29.733256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbdd7c186914052941d3f2e06df563b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:29.743689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbdd7c186914052941d3f2e06df563b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:29.754725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1116/2214] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:29 2022] DELETE /identity/v3/users/8fbdd7c186914052941d3f2e06df563b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:49:29.760379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:29.761007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:29.761264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:29.794250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:29.795781 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:29.811168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:29.879299 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1099/2215] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:29.889723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:29.891430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:29.969497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07de7-2257-4506-92d7-8467c63bb652 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:29.973884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:29.974552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:29.974806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:29.975075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:30.005861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:30.008188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:30.028272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1117/2216] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:30.463388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:30.464895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:30.485367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ae2b-0857-4d6e-b045-67753d614a51 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:30.491139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:30.491843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:30.492074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:30.492380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] PATH_INFO: `/v3/projects/7cf25cde913b4e74ba9b7198aad4a6ba` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:30.493495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf25cde913b4e74ba9b7198aad4a6ba)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:30.495484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:30.594964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf25cde913b4e74ba9b7198aad4a6ba', 'request_id': 'req-48b95ac9-5990-4abd-8e6d-b7e4500eb053'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.608729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf25cde913b4e74ba9b7198aad4a6ba', 'request_id': 'req-48b95ac9-5990-4abd-8e6d-b7e4500eb053'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.622857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf25cde913b4e74ba9b7198aad4a6ba', 'request_id': 'req-48b95ac9-5990-4abd-8e6d-b7e4500eb053'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.646178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] The token cache is being invalidate because project 7cf25cde913b4e74ba9b7198aad4a6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:30.646437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.647061 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.648592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1100/2217] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:30 2022] DELETE /identity/v3/projects/7cf25cde913b4e74ba9b7198aad4a6ba => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:30.652780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:30.664016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e70a8-626b-47c4-87d2-b3aa71669924 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:30.735343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:30.783549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:30.784492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:30.785044 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:30.785430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] PATH_INFO: `/v3/users/491a11b33d34468f89d9ac94ebe27177` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:30.787234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=491a11b33d34468f89d9ac94ebe27177)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:30.789490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:30.855927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491a11b33d34468f89d9ac94ebe27177'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.871850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491a11b33d34468f89d9ac94ebe27177'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.886730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491a11b33d34468f89d9ac94ebe27177'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.887475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491a11b33d34468f89d9ac94ebe27177'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.895286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491a11b33d34468f89d9ac94ebe27177'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:30.901478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1118/2218] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:30 2022] DELETE /identity/v3/users/491a11b33d34468f89d9ac94ebe27177 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:31.214569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:31.216046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:31.231650 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b95ac9-5990-4abd-8e6d-b7e4500eb053 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:31.306878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:31.307523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:31.307801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:31.308076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] PATH_INFO: `/v3/projects/5f67df7a84fa42e289756e2118e7e074` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:31.309293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f67df7a84fa42e289756e2118e7e074)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:31.311259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:31.367461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:31.372210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f67df7a84fa42e289756e2118e7e074', 'request_id': 'req-be828e74-0251-4849-b64a-7bf950f3b305'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.383276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f67df7a84fa42e289756e2118e7e074', 'request_id': 'req-be828e74-0251-4849-b64a-7bf950f3b305'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.390394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f67df7a84fa42e289756e2118e7e074', 'request_id': 'req-be828e74-0251-4849-b64a-7bf950f3b305'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.402505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] The token cache is being invalidate because project 5f67df7a84fa42e289756e2118e7e074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:31.402743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.403461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.405739 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1101/2219] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:31 2022] DELETE /identity/v3/projects/5f67df7a84fa42e289756e2118e7e074 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:31.409369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:31.411127 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:31.424579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0399-8e28-4e35-ac45-c6e9233c9a7f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:31.494497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:31.495141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:31.495416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:31.495687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] PATH_INFO: `/v3/users/9319e70c37944eed894b7038b05d08e8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:31.496931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9319e70c37944eed894b7038b05d08e8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:31.498903 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:31.559102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9319e70c37944eed894b7038b05d08e8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.575348 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9319e70c37944eed894b7038b05d08e8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.578416 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:31.593004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9319e70c37944eed894b7038b05d08e8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.593868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9319e70c37944eed894b7038b05d08e8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.602914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5bcce83b-4e75-471c-aeb6-c89ddbb10706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9319e70c37944eed894b7038b05d08e8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:31.609802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1119/2220] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:31 2022] DELETE /identity/v3/users/9319e70c37944eed894b7038b05d08e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:31.922250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:31.924375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:31.947169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828e74-0251-4849-b64a-7bf950f3b305 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.024338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.025019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.025331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.025684 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] PATH_INFO: `/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.026788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb6fb4c7b254268aa89919fa31df2f3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.028914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.110996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb6fb4c7b254268aa89919fa31df2f3', 'request_id': 'req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:32.120942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb6fb4c7b254268aa89919fa31df2f3', 'request_id': 'req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:32.128364 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb6fb4c7b254268aa89919fa31df2f3', 'request_id': 'req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:32.140626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] The token cache is being invalidate because project 2eb6fb4c7b254268aa89919fa31df2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:32.140938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:32.141625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e918e15-a02b-4e5c-a744-eda9ec3f1af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:32.143613 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1102/2221] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:31 2022] DELETE /identity/v3/projects/2eb6fb4c7b254268aa89919fa31df2f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:32.149404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.149998 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.150117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.171141 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:32.172369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:32.245516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1120/2222] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:32.254694 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.255290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.255290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.276705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:32.277952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:32.286697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1103/2223] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:32.292025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.303142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926f55-b891-46ca-aadd-6c1f0bc06c21 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.308588 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.309232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.309492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.309800 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.310457 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:32.310753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.312372 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.325376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1121/2224] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:49:32.330527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.340921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc2d7-bcee-47a2-ae25-40edf3fb32d3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.347574 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.348185 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.348465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.348736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.349378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.351351 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.382310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1104/2225] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:32 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:32.386685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.397393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637767-95fd-42aa-8073-132e3c14792e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.465970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.466664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.467036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.467338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.467983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.469935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.494515 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1122/2226] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:32 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:32.499536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.512115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729f75c-b2bf-4074-a857-0ec4a68e391f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.518107 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.518720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.519026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.519296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.519944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.521633 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.533373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1105/2227] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:32.537900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.548730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1675-e443-4dce-a721-188fd5b80d26 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.554598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.555194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.555464 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.555748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.556371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.558050 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af3fa-2707-4045-ab45-9ebcba8bba4a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.569960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1123/2228] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:32.574339 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.584997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebab6a-58b9-4911-9ca5-420d0e084c3b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.589893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.590527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.590800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.591069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] PATH_INFO: `/v3/projects/78aa172e874940a681cf4ae4c06b9335/users/e13ca05d1b1a45989abcbc965c8398f1/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.608821 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aa172e874940a681cf4ae4c06b9335, user_id=e13ca05d1b1a45989abcbc965c8398f1, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.611641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.623762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:32.630359 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1106/2229] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:32 2022] PUT /identity/v3/projects/78aa172e874940a681cf4ae4c06b9335/users/e13ca05d1b1a45989abcbc965c8398f1/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:32.636187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d9b7-4497-427f-b511-85ffc8d8fb0c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.636473 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d9b7-4497-427f-b511-85ffc8d8fb0c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.636750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d9b7-4497-427f-b511-85ffc8d8fb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.658030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-45b6d9b7-4497-427f-b511-85ffc8d8fb0c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:32.659454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45b6d9b7-4497-427f-b511-85ffc8d8fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:32.701344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:32.731662 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1124/2230] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:32.742352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:32.744259 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:32.812273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d000-1a83-438a-9c13-922f6329c4b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:32.817680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:32.818559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:32.818835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:32.819100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:32.834630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:32.836204 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:32.850573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1107/2231] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:33.621825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:33.622409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:33.622409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:33.662390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] MFA Rules not processed for user `e13ca05d1b1a45989abcbc965c8398f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:33.663667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:33.739246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1125/2232] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:33.744078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:33.754988 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c06cdf-f6ff-41c1-9e67-6d8ffc7ba86c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:33.760316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:33.760934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:33.761201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:33.761535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:33.762232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:33.764167 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:33.792838 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1108/2233] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:33.797078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:33.808072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb367cd-ac2d-43e0-98f0-78fa20733b00 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:33.871195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:33.871823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:33.872098 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:33.872366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:33.873041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:33.874988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:33.899004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1126/2234] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:33 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:33.902846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:33.913606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff400-c77a-46da-bdf2-9e332e0833ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:33.918571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:33.919189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:33.919462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:33.919727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:33.920375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:33.922007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:33.933080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1109/2235] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:33.937444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:33.948887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92e3d-8f47-401b-8499-6484cd1fccad admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:33.954130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:33.954836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:33.955116 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:33.955484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] PATH_INFO: `/v3/projects/114e9661d2fa456fa7830c2cf17871a0/users/93ffecdd5b774f1facce07acb55e0339/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:33.975672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114e9661d2fa456fa7830c2cf17871a0, user_id=93ffecdd5b774f1facce07acb55e0339, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:33.978434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:33.994636 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1127/2236] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:33 2022] PUT /identity/v3/projects/114e9661d2fa456fa7830c2cf17871a0/users/93ffecdd5b774f1facce07acb55e0339/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:33.998603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:34.009222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184d69-4720-4408-89e6-23c8bdec4fcb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:34.070940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:34.071605 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:34.071915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:34.072231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:34.072931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:34.074651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d32f4-8b9a-4408-81f7-9a612d9dc3bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:34.087064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1110/2237] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:34.092412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:34.103881 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b079b9-5cbe-4e4d-b181-6366041f8719 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:34.109304 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:34.110167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:34.110516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:34.110896 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] PATH_INFO: `/v3/projects/114e9661d2fa456fa7830c2cf17871a0/users/93ffecdd5b774f1facce07acb55e0339/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:34.114827 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=114e9661d2fa456fa7830c2cf17871a0, user_id=93ffecdd5b774f1facce07acb55e0339, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:34.118265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b21047-eb4d-4872-8f23-8c08c227968f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:34.134012 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1128/2238] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:34 2022] PUT /identity/v3/projects/114e9661d2fa456fa7830c2cf17871a0/users/93ffecdd5b774f1facce07acb55e0339/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:34.955940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:34.956492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:34.956492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:34.986459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] MFA Rules not processed for user `93ffecdd5b774f1facce07acb55e0339`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:34.987533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:35.043713 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:35.081945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1111/2239] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:35.093055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:35.093663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:35.093663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:35.114583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] MFA Rules not processed for user `e13ca05d1b1a45989abcbc965c8398f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:35.115807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:35.136246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:35.184007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1129/2240] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:35.195384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:35.196839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:35.281133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbecb-26f1-4f86-ae1d-c4fb9780ae75 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:35.287233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:35.287881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:35.288161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:35.288429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:35.297817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:35.300017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:35.310442 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1112/2241] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:35.392077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:35.455942 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a56cd-3feb-4d8b-89d5-38723e500331 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:35.460432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:35.461138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:35.461488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:35.461856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:35.463721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:35.539255 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:35.541029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:35.554347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1130/2242] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:36.280377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:36.297486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9353d-150b-44ae-920e-29e3a4075524 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:36.318880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:36.320528 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:36.321002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:36.321414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:36.327222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:36.359010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:36.360630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbdae4-419c-4729-899e-0b0d0f4328f5 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:36.373929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1113/2243] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:49:37.679683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:37.692712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c66a6a-d8a3-4d71-8f84-245a8b43de55 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:37.699891 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:37.700611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:37.700959 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:37.701318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:37.703450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:37.717431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:37.720063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:37.736948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1131/2244] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:39.397340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:39.398311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:39.398771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:39.421947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:39.424228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:39.545193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1114/2245] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:49:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:49:39.569758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:39.571219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:39.645474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb8f8-4585-4f41-bb4b-74af8b68aa64 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:39.650945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:39.651661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:39.652149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:39.652487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:39.658677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:39.663892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:39.665805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:39.676267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1132/2246] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:49:45.482667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:45.493000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cfef4-2708-42e8-891a-dd9736fe5001 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:45.496814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:45.497443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:45.497758 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:45.498036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:45.499822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:45.569470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:45.570997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:45.576256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:45.582899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1115/2247] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:48.994278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:48.996456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:49.084256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3739-87ca-4582-b0ff-3f02045f7a18 service swift] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.090336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.090855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.091128 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.091396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.094278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:49.108101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.109806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.113321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:49.115697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:49.121423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1133/2248] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:49.130512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520ccc-6b0d-40e7-a44d-c8e4976a1c7e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.136563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.137115 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.137237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.137513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] PATH_INFO: `/v3/users/bf24539086724dc4aa3d5c569a47e85a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.138754 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf24539086724dc4aa3d5c569a47e85a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.140689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.198027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf24539086724dc4aa3d5c569a47e85a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.198601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf24539086724dc4aa3d5c569a47e85a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.211118 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf24539086724dc4aa3d5c569a47e85a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.224652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf24539086724dc4aa3d5c569a47e85a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.235468 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-304bea96-aa5b-45a3-918a-ac6ca918945a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf24539086724dc4aa3d5c569a47e85a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.244262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1116/2249] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:49:49 2022] DELETE /identity/v3/users/bf24539086724dc4aa3d5c569a47e85a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:49:49.457510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:49.480058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4affd0-9492-4eac-a2bd-c056ff347c7e service placement] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.562040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.562683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.562957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.563222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] PATH_INFO: `/v3/projects/7ccb376d0c0c4ca3bcf0134573c2da2b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.564406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccb376d0c0c4ca3bcf0134573c2da2b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.566356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.617335 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccb376d0c0c4ca3bcf0134573c2da2b', 'request_id': 'req-00ebb5c6-4146-4d1b-ab71-312aace19710'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.626606 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccb376d0c0c4ca3bcf0134573c2da2b', 'request_id': 'req-00ebb5c6-4146-4d1b-ab71-312aace19710'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.633369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccb376d0c0c4ca3bcf0134573c2da2b', 'request_id': 'req-00ebb5c6-4146-4d1b-ab71-312aace19710'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.645488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] The token cache is being invalidate because project 7ccb376d0c0c4ca3bcf0134573c2da2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:49:49.645804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.646549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00ebb5c6-4146-4d1b-ab71-312aace19710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:49:49.648158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1134/2250] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:49:49 2022] DELETE /identity/v3/projects/7ccb376d0c0c4ca3bcf0134573c2da2b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:49.653266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.653553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.653863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.674142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:49.675410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:49.737831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1117/2251] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:49.746246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.746506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.746779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.769599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:49.770869 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:49.779311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1135/2252] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:49.784021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:49.793955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5985ba5-0566-464d-8b6f-5d76451d8739 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.799473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.800184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.800465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.800751 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.801520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:49:49.801863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.803553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.817402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1118/2253] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:49:49.822061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:49.831990 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab8602-3e94-453e-be73-26e33d7e4d4f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.836985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.837617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.837907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.838182 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.839247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.840877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.845974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:49.877565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1136/2254] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:49.881788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:49.892223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d8c7-ec89-4576-ab1e-ffa4e4b200f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:49.952403 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:49.953000 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:49.953270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:49.953543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:49.954235 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:49.956256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:49.964601 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:49.987399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1119/2255] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:49:49 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:49:49.992489 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:50.004614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dfaad-bf89-4974-a890-c849e545d0f0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:50.010812 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:50.011698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:50.012043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:50.012286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:50.013295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:50.015009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:50.027440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1137/2256] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:50.031692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:50.042404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f304-26be-440d-a6b6-8b11e7ff305c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:50.047858 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:50.048674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:50.048978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:50.049251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:50.049955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:50.051634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803c86-c259-47e4-bfb0-614d70b02030 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:50.066015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1120/2257] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:49:50.071746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:50.084249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432da73-bfda-4b59-bec6-b2d7a7ce5df6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:50.089184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:50.090101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:50.090384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:50.090851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] PATH_INFO: `/v3/projects/f9ba4d6ea4114a8b85fc49f9d11f0345/users/ea25f4ca5bb841a8a7a766d8f9252007/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:50.107584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ba4d6ea4114a8b85fc49f9d11f0345, user_id=ea25f4ca5bb841a8a7a766d8f9252007, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:50.110325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:50.125887 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1138/2258] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:49:50 2022] PUT /identity/v3/projects/f9ba4d6ea4114a8b85fc49f9d11f0345/users/ea25f4ca5bb841a8a7a766d8f9252007/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:49:50.131453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:50.131989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:50.131989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:50.158360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:50.159598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:50.248340 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1121/2259] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:50.259234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:50.261408 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:50.334728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4681e-57e5-4d30-899a-f518c65a8559 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:50.339373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:50.339997 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:50.340285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:50.340551 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:50.352350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:50.354245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc55a-24d9-4e26-b095-0577280fcec2 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:50.367620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1139/2260] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:50.967764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:50.969597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:51.046361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3353cb6-e9fe-4dbd-a81b-28844cdb0b40 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:51.050232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:51.050859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:51.051131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:51.051400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:51.053880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:51.126982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:51.128477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:51.140094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1122/2261] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:55.179329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f0d4-e999-4797-8f95-ba7c00035473 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:55.179807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f0d4-e999-4797-8f95-ba7c00035473 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:55.179914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f0d4-e999-4797-8f95-ba7c00035473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:55.215426 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2ac8f0d4-e999-4797-8f95-ba7c00035473 None None] MFA Rules not processed for user `ea25f4ca5bb841a8a7a766d8f9252007`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:55.216650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2ac8f0d4-e999-4797-8f95-ba7c00035473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:55.287068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1140/2262] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:49:55.301786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:49:55.303281 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:55.337080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:55.381604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72207cc-7271-4d5a-83c6-7aa5facadc8a service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:49:55.387291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:49:55.387902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:55.388171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:55.388432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:55.397507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:49:55.399132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:49:55.413543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1123/2263] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:49:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:57.102443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:49:57.103038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:49:57.103038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:49:57.123892 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] MFA Rules not processed for user `ea25f4ca5bb841a8a7a766d8f9252007`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:49:57.125442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:49:57.138430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1141/2264] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:05.405131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=21 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:07.117870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:11.318667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:11.320878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:11.398492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9d71-882f-48ea-a03f-72a0b9e07ccc service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:11.403765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:11.404380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:11.404658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:11.404934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:11.406799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:11.419936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:11.421533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:11.432665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1124/2265] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:11.922615 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:11.924849 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:11.943828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d56fb-6064-48e2-af4e-84a9d231fc31 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:11.949020 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:11.949696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:11.949974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:11.950243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] PATH_INFO: `/v3/users/e13ca05d1b1a45989abcbc965c8398f1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:11.951622 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13ca05d1b1a45989abcbc965c8398f1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:11.953663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:12.008976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13ca05d1b1a45989abcbc965c8398f1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.016503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13ca05d1b1a45989abcbc965c8398f1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.029360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13ca05d1b1a45989abcbc965c8398f1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.030109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13ca05d1b1a45989abcbc965c8398f1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.037762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13ca05d1b1a45989abcbc965c8398f1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.044214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1142/2266] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:11 2022] DELETE /identity/v3/users/e13ca05d1b1a45989abcbc965c8398f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:12.227137 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:12.239273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcad6a-c8b6-42b4-818d-fcdf91d4ce11 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:12.303760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:12.304413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:12.304728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:12.305006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] PATH_INFO: `/v3/projects/78aa172e874940a681cf4ae4c06b9335` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:12.306245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aa172e874940a681cf4ae4c06b9335)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:12.308186 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:12.365484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aa172e874940a681cf4ae4c06b9335', 'request_id': 'req-528ea8ad-671a-461c-a4f6-e9a51c21f842'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.374561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aa172e874940a681cf4ae4c06b9335', 'request_id': 'req-528ea8ad-671a-461c-a4f6-e9a51c21f842'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.380577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aa172e874940a681cf4ae4c06b9335', 'request_id': 'req-528ea8ad-671a-461c-a4f6-e9a51c21f842'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.392216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] The token cache is being invalidate because project 78aa172e874940a681cf4ae4c06b9335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:12.392496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.393165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.394718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1125/2267] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:12 2022] DELETE /identity/v3/projects/78aa172e874940a681cf4ae4c06b9335 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:12.398786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:12.400324 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:12.413857 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4559c63-70c7-4651-b522-a11654f1015d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:12.480572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:12.481192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:12.481452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:12.481799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] PATH_INFO: `/v3/users/93ffecdd5b774f1facce07acb55e0339` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:12.482975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ffecdd5b774f1facce07acb55e0339)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:12.484951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:12.549734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ffecdd5b774f1facce07acb55e0339'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.560262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ffecdd5b774f1facce07acb55e0339'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.572346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ffecdd5b774f1facce07acb55e0339'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.573000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ffecdd5b774f1facce07acb55e0339'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.575013 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:12.583327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f1452205-940f-4760-8977-b661e9797a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ffecdd5b774f1facce07acb55e0339'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.590649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1143/2268] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:12 2022] DELETE /identity/v3/users/93ffecdd5b774f1facce07acb55e0339 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:12.810487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:12.812159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:12.830687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea8ad-671a-461c-a4f6-e9a51c21f842 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:12.852827 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:12.909669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:12.910191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:12.910471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:12.910742 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] PATH_INFO: `/v3/projects/114e9661d2fa456fa7830c2cf17871a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:12.912057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] RBAC: Authorizing `identity:delete_project(project_id=114e9661d2fa456fa7830c2cf17871a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:12.913913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:12.981378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114e9661d2fa456fa7830c2cf17871a0', 'request_id': 'req-243d831a-58af-4e53-8a62-b140feea261f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:12.994348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114e9661d2fa456fa7830c2cf17871a0', 'request_id': 'req-243d831a-58af-4e53-8a62-b140feea261f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:13.003840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114e9661d2fa456fa7830c2cf17871a0', 'request_id': 'req-243d831a-58af-4e53-8a62-b140feea261f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:13.024535 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] The token cache is being invalidate because project 114e9661d2fa456fa7830c2cf17871a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:13.029032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:13.030146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-243d831a-58af-4e53-8a62-b140feea261f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:13.033033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1126/2269] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:12 2022] DELETE /identity/v3/projects/114e9661d2fa456fa7830c2cf17871a0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:13.038993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.039546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.039546 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.061861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:13.063064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:13.145785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1144/2270] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:13.156882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.157193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.157503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.183760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:13.185692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:13.196270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1127/2271] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:13.202069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.214494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddaf0f-bb5f-4914-9ddb-71091238687d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.219799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.220587 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.220870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.221115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.222208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:50:13.222930 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.224580 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.240123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1145/2272] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:50:13.245766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.256370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070cbea-a90f-4084-ae07-41e70e39777b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.261280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.261955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.262233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.262496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.263142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.265086 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.299110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1128/2273] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:13 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:13.303868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.317771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845be269-efb3-4f00-bfc8-9b424f7b0348 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.390196 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.390792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.391068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.391340 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.392090 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.394945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.432729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1146/2274] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:13 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:13.437102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.448562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1d1c-f58a-4262-adad-6843faac02fa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.453705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.454365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.454671 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.454943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.455607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.457231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.467733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1129/2275] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:13.471918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.484443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce631ff3-90a6-4e5c-851b-e4bc473c33bf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.490575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.491131 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.491420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.491686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.492326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.494073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149abd8c-b2d1-43a7-8e32-f6cec54437ff admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.509631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1147/2276] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:13.513890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.525305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155379c-44f6-4853-9f64-08338e8f928c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.530389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.531063 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.531336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.531609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] PATH_INFO: `/v3/projects/dca5d3423615455aa4a2321776e508d6/users/20bd1ac9a20c4106bd8fdf2586955b0f/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.549880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca5d3423615455aa4a2321776e508d6, user_id=20bd1ac9a20c4106bd8fdf2586955b0f, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.552667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.570510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1130/2277] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:13 2022] PUT /identity/v3/projects/dca5d3423615455aa4a2321776e508d6/users/20bd1ac9a20c4106bd8fdf2586955b0f/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:13.581729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374934ae-7155-4de5-aaba-a5247ea2aa93 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.581981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374934ae-7155-4de5-aaba-a5247ea2aa93 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.582270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374934ae-7155-4de5-aaba-a5247ea2aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.605600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-374934ae-7155-4de5-aaba-a5247ea2aa93 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:13.606885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-374934ae-7155-4de5-aaba-a5247ea2aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:13.673253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:13.684957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1148/2278] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:13.695941 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:13.697859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:13.779501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:13.786331 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9255b1a-2588-425a-8031-24609833ead0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:13.791005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:13.791790 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:13.792269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:13.792541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:13.802565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:13.804015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:13.814481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1131/2279] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:19.154160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.154671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.154787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.184806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] MFA Rules not processed for user `20bd1ac9a20c4106bd8fdf2586955b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:19.186062 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:19.258591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1149/2280] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:19.263332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.273905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8decf-8192-4bbd-afe7-3dda7bced00f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.278760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.279372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.279655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.279934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.280577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.282597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.316676 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1132/2281] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:19 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:19.321393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.339034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df5ce8-bfc5-4310-8b6c-ae394bdd72e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.445086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.446017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.446017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.446295 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.446958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.449782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.479329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1150/2282] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:19 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:19.483504 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.496048 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797b7-d201-4827-9f20-b1d48f265c9a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.510044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.511139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.511518 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.511899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.512750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.514691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.531459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1133/2283] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:19.536045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.554361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc4c0-b6ba-4d34-98b6-5785b287b3d2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.565537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.566350 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.568293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.568616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] PATH_INFO: `/v3/projects/c25357cc67424c51a4fd8a545291160c/users/e37084aad63f43d8b6644b5ae67c9f72/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.587923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25357cc67424c51a4fd8a545291160c, user_id=e37084aad63f43d8b6644b5ae67c9f72, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.592243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.609805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1151/2284] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:19 2022] PUT /identity/v3/projects/c25357cc67424c51a4fd8a545291160c/users/e37084aad63f43d8b6644b5ae67c9f72/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:19.614327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.624787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799577-9421-4cd8-b0d1-8854ad8cfe5e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.699168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.700250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.700554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.702883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.702883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.705412 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.719902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1134/2285] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:19.724100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:19.738740 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa021-33cc-4c3a-8406-ea15247bb263 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:19.745436 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:19.746475 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:19.746888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:19.747257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] PATH_INFO: `/v3/projects/c25357cc67424c51a4fd8a545291160c/users/e37084aad63f43d8b6644b5ae67c9f72/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:19.751797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25357cc67424c51a4fd8a545291160c, user_id=e37084aad63f43d8b6644b5ae67c9f72, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:19.759660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4212a-d6bf-46ee-95a1-3c1b52be3b1b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:19.788228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1152/2286] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:19 2022] PUT /identity/v3/projects/c25357cc67424c51a4fd8a545291160c/users/e37084aad63f43d8b6644b5ae67c9f72/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:22.832563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:22.835112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:22.970298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a4c9-460b-4012-b9a1-24b6cbc12b11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:23.099787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:23.100649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:23.100922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:23.101217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:23.106321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:23.156239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:23.266296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:23.268128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:23.293628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1135/2287] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:24.797452 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b680-f680-4535-b132-f702d201db02 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:24.798035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b680-f680-4535-b132-f702d201db02 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:24.798035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b680-f680-4535-b132-f702d201db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:24.845278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-51a8b680-f680-4535-b132-f702d201db02 None None] MFA Rules not processed for user `e37084aad63f43d8b6644b5ae67c9f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:24.846945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-51a8b680-f680-4535-b132-f702d201db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:24.910513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:24.971392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1153/2288] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:24.983255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:24.985265 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:25.070887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e8de-a405-4c4b-b2fe-98c6c039fee7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:25.079381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fd96c9fa48809e2dfa85b11d8d11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:25.080878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:25.081329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:25.081870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:25.157219 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:25.159917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:25.172643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1136/2289] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:25.346724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:25.347018 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:25.347292 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:25.384082 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:25.385460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:25.499468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1154/2290] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:25.528640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:25.530348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:25.631120 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087446aa-b160-44e0-ad11-6f284607bc97 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:25.650458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:25.651009 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:25.652414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:25.652414 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:25.668801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:25.678980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:25.691297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1137/2291] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:50:27.853288 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:27.856237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:27.882199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193745c-ea7d-4ef0-bfb3-f11f47120379 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:27.887199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:27.888156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:27.888653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:27.889158 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] PATH_INFO: `/v3/users/80168c16c0ca44cb86c9691fda4aab5e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:27.890659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80168c16c0ca44cb86c9691fda4aab5e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:27.893097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:27.969530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80168c16c0ca44cb86c9691fda4aab5e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:27.981211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80168c16c0ca44cb86c9691fda4aab5e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.002145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80168c16c0ca44cb86c9691fda4aab5e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.003712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80168c16c0ca44cb86c9691fda4aab5e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.013325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e42cba0-527e-47f4-aade-a2ef558ff6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80168c16c0ca44cb86c9691fda4aab5e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.026837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1155/2292] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:27 2022] DELETE /identity/v3/users/80168c16c0ca44cb86c9691fda4aab5e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:28.276108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:28.282817 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:28.294452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715d20-81f7-4774-9124-89f2e1ba4648 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:28.398731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:28.399483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:28.400197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:28.400197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] PATH_INFO: `/v3/projects/5aa86125d1e843208c394cb6e2ae0c49` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:28.402233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa86125d1e843208c394cb6e2ae0c49)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:28.404296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:28.554925 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa86125d1e843208c394cb6e2ae0c49', 'request_id': 'req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.570986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa86125d1e843208c394cb6e2ae0c49', 'request_id': 'req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.591123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa86125d1e843208c394cb6e2ae0c49', 'request_id': 'req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.620670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] The token cache is being invalidate because project 5aa86125d1e843208c394cb6e2ae0c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:28.621545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.622176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7a194cfa-8f6f-43ba-8774-6c4ae2d5de0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:28.629829 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1138/2293] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:28 2022] DELETE /identity/v3/projects/5aa86125d1e843208c394cb6e2ae0c49 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:28.633758 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:28.634285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:28.635751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:28.666679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:28.667927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:28.771327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:28.837518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1156/2294] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:28.846053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:28.846388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:28.846608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:28.874655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:28.876785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:28.896221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1139/2295] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:28.897107 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:28.911100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42a6aa-48fc-4009-956a-b948a8467724 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:28.920179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:28.920810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:28.921888 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:28.922323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:28.923146 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:50:28.923743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:28.925317 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:28.940792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1157/2296] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:50:28.945328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:28.960293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46306144-dc04-415d-bed2-036d00c2c156 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:28.965321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:28.966006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:28.966280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:28.966548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:28.967198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:28.969221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.013489 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1140/2297] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:28 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:29.014832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.029921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba148a-8ddc-4558-9d8c-e4658e7a477e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.103306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.104207 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.104491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.104766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.105403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.107516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.134129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1158/2298] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:29 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:29.138091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.149123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543939ea-3de5-490e-bf2c-527a38aab549 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.156623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.157251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.157523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.157959 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.158600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.160207 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.173632 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1141/2299] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:29.176346 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.201666 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96ce0c-1b2f-400a-9d85-d494616d44f9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.208968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.209754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.210138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.210513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.211287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.213468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb7f84-8aed-4bad-969a-8234cfab78cd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.233810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1159/2300] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:29.234606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.250165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a896-d1b2-4f4e-94cd-4120a0910935 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.257298 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.258068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.258068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.258275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] PATH_INFO: `/v3/projects/f5211617a32d4e8d87cb8f0cde405a95/users/bd06dde78ee74c53be1d4bc4136866ef/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.276548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5211617a32d4e8d87cb8f0cde405a95, user_id=bd06dde78ee74c53be1d4bc4136866ef, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.279303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.298958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1142/2301] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:29 2022] PUT /identity/v3/projects/f5211617a32d4e8d87cb8f0cde405a95/users/bd06dde78ee74c53be1d4bc4136866ef/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:29.309795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1af364-5751-4774-9641-486faa857b0d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.310080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1af364-5751-4774-9641-486faa857b0d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.310363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1af364-5751-4774-9641-486faa857b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.357253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dd1af364-5751-4774-9641-486faa857b0d None None] MFA Rules not processed for user `bd06dde78ee74c53be1d4bc4136866ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:29.358681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dd1af364-5751-4774-9641-486faa857b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:29.465392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1160/2302] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:29.470194 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.521795 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:29.567810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ffe0d-9d0c-4177-84a8-b9c21ef9fd8b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.573174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.573952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.574303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.574649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.575406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.577705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.615534 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1143/2303] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:29 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:29.621940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1af364-5751-4774-9641-486faa857b0d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.644620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1af364-5751-4774-9641-486faa857b0d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.714336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:29.756061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.756692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.757080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.757254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.757931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.759913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.791577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1161/2304] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:29 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:29.793179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.809022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360be7-c379-40f3-94b3-55c16eacaf2f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.816075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.816689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.816963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.817232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.817922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.820606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.837659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1144/2305] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:29.840375 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.859902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafc9f-90e4-4a31-a62a-fc6b3f01d7df admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:29.871404 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:29.872251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:29.872625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:29.872994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] PATH_INFO: `/v3/projects/f8c3f93646944c82a0d78c5feabd9d78/users/4b1af44dd63b47e4be58e3db96950b44/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:29.893994 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c3f93646944c82a0d78c5feabd9d78, user_id=4b1af44dd63b47e4be58e3db96950b44, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:29.897087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:29.915712 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1162/2306] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:29 2022] PUT /identity/v3/projects/f8c3f93646944c82a0d78c5feabd9d78/users/4b1af44dd63b47e4be58e3db96950b44/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:29.921257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:29.935090 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f1cf-4cc0-4d3c-89fb-d379c50e66d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:30.030317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:30.030951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:30.031233 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:30.031500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:30.032151 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:30.033953 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ccf65-f572-4dae-b910-e75a9923f21e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:30.049008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1145/2307] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:30.053068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:30.068341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3747-9bb4-4e45-a643-57c340cc6051 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:30.080474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:30.081343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:30.083105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:30.087336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] PATH_INFO: `/v3/projects/f8c3f93646944c82a0d78c5feabd9d78/users/4b1af44dd63b47e4be58e3db96950b44/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:30.092571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c3f93646944c82a0d78c5feabd9d78, user_id=4b1af44dd63b47e4be58e3db96950b44, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:30.095310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:30.111927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1163/2308] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:30 2022] PUT /identity/v3/projects/f8c3f93646944c82a0d78c5feabd9d78/users/4b1af44dd63b47e4be58e3db96950b44/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:30.124952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:30.125845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:30.126225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:30.205589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] MFA Rules not processed for user `4b1af44dd63b47e4be58e3db96950b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:30.207994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:30.308660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1146/2309] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:30.323420 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:30.327338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:30.401693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d55ac-c8ff-4c7c-87d0-7a9a4ff69eff admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:30.405952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:30.406643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:30.406991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:30.407330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:30.435231 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:30.436694 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77e16-3263-40df-9f0d-588bc122dd65 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:30.458917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1164/2310] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:30.960114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:30.991909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:31.041189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da8c76-0c96-4cab-8a4d-aefd2cd63a7b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:31.046343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:31.046986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:31.047388 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:31.050160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] PATH_INFO: `/v3/users/bd06dde78ee74c53be1d4bc4136866ef` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:31.051343 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd06dde78ee74c53be1d4bc4136866ef)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:31.053564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:31.112322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd06dde78ee74c53be1d4bc4136866ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:31.113490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd06dde78ee74c53be1d4bc4136866ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:31.122855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd06dde78ee74c53be1d4bc4136866ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:31.139220 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd06dde78ee74c53be1d4bc4136866ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:31.148560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd06dde78ee74c53be1d4bc4136866ef'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:31.155837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1147/2311] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:30 2022] DELETE /identity/v3/users/bd06dde78ee74c53be1d4bc4136866ef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:31.160447 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:31.160963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:31.160963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:31.181992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:31.183228 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:31.256061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1165/2312] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:31.267247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:31.268714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:31.339147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686d28-7e13-470b-8867-b405a58e40a0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:31.343421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:31.344040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:31.344316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:31.344584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:31.355476 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:31.356943 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:31.368931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1148/2313] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:50:31.991804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:31.993660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:32.018953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f77dfe-2fe1-4d1d-97b2-32851b8a6dee None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:32.024553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:32.025491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:32.026001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:32.026262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] PATH_INFO: `/v3/projects/f5211617a32d4e8d87cb8f0cde405a95` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:32.027598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5211617a32d4e8d87cb8f0cde405a95)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:32.029953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:32.072569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:32.093263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5211617a32d4e8d87cb8f0cde405a95', 'request_id': 'req-f9bfae47-5363-49f0-bdb3-25c95d81be63'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.103853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5211617a32d4e8d87cb8f0cde405a95', 'request_id': 'req-f9bfae47-5363-49f0-bdb3-25c95d81be63'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.110989 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5211617a32d4e8d87cb8f0cde405a95', 'request_id': 'req-f9bfae47-5363-49f0-bdb3-25c95d81be63'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.126689 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] The token cache is being invalidate because project f5211617a32d4e8d87cb8f0cde405a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:32.127095 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.128021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.129861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1166/2314] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:31 2022] DELETE /identity/v3/projects/f5211617a32d4e8d87cb8f0cde405a95 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:32.133860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:32.145873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24e16-53df-4272-8859-45f9e21f7068 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:32.201545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:32.221166 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:32.221853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:32.222131 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:32.222401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] PATH_INFO: `/v3/users/4b1af44dd63b47e4be58e3db96950b44` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:32.223565 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1af44dd63b47e4be58e3db96950b44)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:32.226974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:32.304251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1af44dd63b47e4be58e3db96950b44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.305333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1af44dd63b47e4be58e3db96950b44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.317494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1af44dd63b47e4be58e3db96950b44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.333971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1af44dd63b47e4be58e3db96950b44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.345557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-658317fb-4fdd-4c51-8115-8ebfa52a315e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1af44dd63b47e4be58e3db96950b44'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.352444 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1149/2315] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:32 2022] DELETE /identity/v3/users/4b1af44dd63b47e4be58e3db96950b44 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:32.741376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:32.741376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:32.766943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfae47-5363-49f0-bdb3-25c95d81be63 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:32.846085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:32.846741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:32.847118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:32.847471 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] PATH_INFO: `/v3/projects/f8c3f93646944c82a0d78c5feabd9d78` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:32.849193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c3f93646944c82a0d78c5feabd9d78)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:32.851219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:32.915864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c3f93646944c82a0d78c5feabd9d78', 'request_id': 'req-7df0ca99-89d9-4a1a-8c11-67d65704c95c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.928766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c3f93646944c82a0d78c5feabd9d78', 'request_id': 'req-7df0ca99-89d9-4a1a-8c11-67d65704c95c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.935320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c3f93646944c82a0d78c5feabd9d78', 'request_id': 'req-7df0ca99-89d9-4a1a-8c11-67d65704c95c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.957215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] The token cache is being invalidate because project f8c3f93646944c82a0d78c5feabd9d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:32.957516 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.960677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7df0ca99-89d9-4a1a-8c11-67d65704c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:32.963856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1167/2316] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:32 2022] DELETE /identity/v3/projects/f8c3f93646944c82a0d78c5feabd9d78 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:32.967452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:32.967809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:32.968159 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:32.992638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:32.994249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:33.081729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1150/2317] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:33.086743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565000-d84c-417c-b735-702085c155a1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.087108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565000-d84c-417c-b735-702085c155a1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.087498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565000-d84c-417c-b735-702085c155a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.110458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c1565000-d84c-417c-b735-702085c155a1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:33.112008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c1565000-d84c-417c-b735-702085c155a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:33.122368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1168/2318] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:33.126666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.137541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cbe57-a578-4a9d-8238-1bfdff654f53 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.143849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.144472 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.144752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.145024 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.145719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:50:33.146026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.147721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.161050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1151/2319] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:50:33.165482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565000-d84c-417c-b735-702085c155a1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.176579 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565000-d84c-417c-b735-702085c155a1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.181567 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.182584 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.183093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.183577 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.184616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.187614 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.229339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1169/2320] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:33.233612 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.245463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249560-650e-4269-9329-3d3cf97a1605 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.309531 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:33.320925 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.322273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.322761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.323270 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.324200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.326402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.357321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1152/2321] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:33.359219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.371597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b7c7-9421-4401-bcdd-64b77cb4498e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.376618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.377499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.377871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.378209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.378993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.380686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.395376 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1170/2322] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:33.401360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.412992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c12d9-2cd1-4776-823f-fdf0ba8341db admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.418002 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.418768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.419094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.419370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.420140 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.422145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cf83a-8a3f-4a2c-910c-ed0611689fc0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.439049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1153/2323] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:33.440441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.455259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18682bd-73b9-4c26-9ab2-b5721d42a4bf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.460493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.461241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.461743 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.462085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] PATH_INFO: `/v3/projects/bec94cf7c3a149acb435a6fc0f92b576/users/0cb14bac1362434f80b8a7c9fc88adfa/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.465541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:33.487035 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec94cf7c3a149acb435a6fc0f92b576, user_id=0cb14bac1362434f80b8a7c9fc88adfa, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.490097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.509674 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1171/2324] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:33 2022] PUT /identity/v3/projects/bec94cf7c3a149acb435a6fc0f92b576/users/0cb14bac1362434f80b8a7c9fc88adfa/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:33.518510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.518857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.519200 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.557110 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] MFA Rules not processed for user `0cb14bac1362434f80b8a7c9fc88adfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:33.558494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:33.638948 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1154/2325] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:33.643968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.731977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de953187-63fa-4eff-ba7d-39006281e4da admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.738518 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.739185 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.739571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.739767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.740401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.742354 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.775698 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1172/2326] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:33.779514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.793052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27832050-5269-4065-8f1a-7ac54103e19e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.862421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.863394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.863672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.863940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.864589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.866560 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.896199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1155/2327] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:33 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:33.896433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.911437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5c33a-4629-4b12-ba5a-793fe973be89 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.918364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.918928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.919220 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.919540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.920199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.921830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:33.934311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1173/2328] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:33.940334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:33.949488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9df7-44ca-46c5-9dfc-1d491fb9efd2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:33.954279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:33.954987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:33.955266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:33.955561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] PATH_INFO: `/v3/projects/c8a0ce63987746d5a49580262a0c276a/users/879d65c343f140c6b70d49e6a9f85ffb/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:33.976872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a0ce63987746d5a49580262a0c276a, user_id=879d65c343f140c6b70d49e6a9f85ffb, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:33.982596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:34.004156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1156/2329] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:33 2022] PUT /identity/v3/projects/c8a0ce63987746d5a49580262a0c276a/users/879d65c343f140c6b70d49e6a9f85ffb/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:34.005807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:34.016322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345b7d-9c15-4949-a5a2-943b1a5d906b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:34.089172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:34.090051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:34.090400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:34.090746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:34.091427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:34.093064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02fdf6-73a4-4d1c-b917-015d5b6b547f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:34.107821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1174/2330] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:50:34.111740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:34.123033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7132f72-ee1c-4596-8fd4-35f82a382e63 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:34.130357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:34.131128 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:34.131491 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:34.131831 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] PATH_INFO: `/v3/projects/c8a0ce63987746d5a49580262a0c276a/users/879d65c343f140c6b70d49e6a9f85ffb/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:34.134484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a0ce63987746d5a49580262a0c276a, user_id=879d65c343f140c6b70d49e6a9f85ffb, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:34.137269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:34.152655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1157/2331] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:34 2022] PUT /identity/v3/projects/c8a0ce63987746d5a49580262a0c276a/users/879d65c343f140c6b70d49e6a9f85ffb/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:34.166723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884865-73ce-416d-92d1-2438a1d9e9b7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:34.166723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884865-73ce-416d-92d1-2438a1d9e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:34.166723 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884865-73ce-416d-92d1-2438a1d9e9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:34.199445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b7884865-73ce-416d-92d1-2438a1d9e9b7 None None] MFA Rules not processed for user `879d65c343f140c6b70d49e6a9f85ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:34.200708 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b7884865-73ce-416d-92d1-2438a1d9e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:34.258279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:34.290142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1175/2332] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:34.302634 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:34.304501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:34.324078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:34.385136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95db3-4515-4868-b480-4f2f7cde783e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:34.389012 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:34.389678 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:34.389956 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:34.390222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:34.502221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:34.502473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:34.516283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1158/2333] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:36.050294 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:36.050836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:36.050939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:36.070321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] MFA Rules not processed for user `20bd1ac9a20c4106bd8fdf2586955b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:36.071523 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:36.134306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1176/2334] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:50:36.408765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:36.410991 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:36.476056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3217-f364-41b5-b6d4-5f0253492790 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:36.479915 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:36.480488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:36.480793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:36.481057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:36.482893 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:36.493042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:36.494492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f4a3-7505-46a8-aa03-62be4d761b13 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:36.502579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1159/2335] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:37.160956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:37.171326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35286-b272-4376-9ce3-a2e89c055613 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:37.175894 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:37.176553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:37.176840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:37.177114 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:37.188142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:37.189830 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:37.200639 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1177/2336] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:38.294030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:38.294820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:38.294820 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:38.320409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:38.322757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:38.380333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1160/2337] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Oct 17 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:38.397344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:38.399679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:38.478029 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5c58-0b21-405f-9add-0c6534a9b0e2 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:38.483548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:38.484165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:38.484423 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:38.484693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:38.494660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:38.496285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a4a60-a2d4-4eb2-9823-7665dcab0732 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:38.505368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1178/2338] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 17:50:48.373391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:48.501619 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=73 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:50.301044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:50.376749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1a439-13be-42eb-abd9-90820a04b04b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:50.381728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:50.382215 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:50.382486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:50.382750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] PATH_INFO: `/v3/users/0cb14bac1362434f80b8a7c9fc88adfa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:50.383890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb14bac1362434f80b8a7c9fc88adfa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:50.385860 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:50.438279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb14bac1362434f80b8a7c9fc88adfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:50.439169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb14bac1362434f80b8a7c9fc88adfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:50.456878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb14bac1362434f80b8a7c9fc88adfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:50.476038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb14bac1362434f80b8a7c9fc88adfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:50.484176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb14bac1362434f80b8a7c9fc88adfa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:50.492681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1161/2339] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:50 2022] DELETE /identity/v3/users/0cb14bac1362434f80b8a7c9fc88adfa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:50.499303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:50.499876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:50.499876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:50.525648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:50.525948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:50.593061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1179/2340] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:50.604003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:50.605773 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:50.683076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa336-f834-4681-8d33-2b07895f11f9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:50.686952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:50.687572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:50.688305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:50.688305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:50.707522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:50.709556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:50.722176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1162/2341] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:51.028665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:51.030657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:51.046437 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80d84-c9f3-4426-9cec-f90fb654fcc6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:51.053268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:51.053965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:51.054241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:51.054506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] PATH_INFO: `/v3/projects/bec94cf7c3a149acb435a6fc0f92b576` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:51.055738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec94cf7c3a149acb435a6fc0f92b576)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:51.057683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:51.138343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec94cf7c3a149acb435a6fc0f92b576', 'request_id': 'req-c1c8d3c8-352c-4f77-819d-e80284bc634e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.148720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec94cf7c3a149acb435a6fc0f92b576', 'request_id': 'req-c1c8d3c8-352c-4f77-819d-e80284bc634e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.156046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec94cf7c3a149acb435a6fc0f92b576', 'request_id': 'req-c1c8d3c8-352c-4f77-819d-e80284bc634e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.169890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] The token cache is being invalidate because project bec94cf7c3a149acb435a6fc0f92b576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:51.170134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.170919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c1c8d3c8-352c-4f77-819d-e80284bc634e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.174257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1180/2342] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:51 2022] DELETE /identity/v3/projects/bec94cf7c3a149acb435a6fc0f92b576 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:51.178266 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:51.189523 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184826dc-2a72-47a1-a433-1ac78d60ff8f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:51.219867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:51.354544 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:51.359608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:51.360040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:51.360609 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] PATH_INFO: `/v3/users/879d65c343f140c6b70d49e6a9f85ffb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:51.362184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879d65c343f140c6b70d49e6a9f85ffb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:51.365156 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:51.430096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879d65c343f140c6b70d49e6a9f85ffb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.431434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879d65c343f140c6b70d49e6a9f85ffb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.443218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879d65c343f140c6b70d49e6a9f85ffb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.462470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879d65c343f140c6b70d49e6a9f85ffb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.470629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879d65c343f140c6b70d49e6a9f85ffb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:51.477242 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1163/2343] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:51 2022] DELETE /identity/v3/users/879d65c343f140c6b70d49e6a9f85ffb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:51.853905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fa2ad-341b-4a94-8ec9-555177dbe5b0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:51.854390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fa2ad-341b-4a94-8ec9-555177dbe5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:51.854602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fa2ad-341b-4a94-8ec9-555177dbe5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:51.876533 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b42fa2ad-341b-4a94-8ec9-555177dbe5b0 None None] MFA Rules not processed for user `ea25f4ca5bb841a8a7a766d8f9252007`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:51.878572 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b42fa2ad-341b-4a94-8ec9-555177dbe5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:51.942592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1181/2344] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:51.990958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:51.992592 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:52.073466 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ba434-41e8-4052-a6f3-27ecf2438e70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.080049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.080707 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.080983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.081249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] PATH_INFO: `/v3/projects/c8a0ce63987746d5a49580262a0c276a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.082503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a0ce63987746d5a49580262a0c276a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.084436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.134477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:52.140706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a0ce63987746d5a49580262a0c276a', 'request_id': 'req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:52.154122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a0ce63987746d5a49580262a0c276a', 'request_id': 'req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:52.161195 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a0ce63987746d5a49580262a0c276a', 'request_id': 'req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:52.173030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] The token cache is being invalidate because project c8a0ce63987746d5a49580262a0c276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:52.173372 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:52.174163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-96d8356b-ab37-4fe1-8836-4ac4a49e2b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:52.175731 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1164/2345] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:51 2022] DELETE /identity/v3/projects/c8a0ce63987746d5a49580262a0c276a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:52.180634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.180915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.181188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.200790 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:52.202007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:52.230015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:52.273453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1182/2346] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:52.282554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.283098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.283463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.305456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:52.306724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:52.315610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1165/2347] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:50:52.321696 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.335056 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c3ed8-ed08-4a01-b165-cdd2cd93bd24 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.343120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.344227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.344858 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.345356 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.346609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:50:52.347166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.350323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.368923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1183/2348] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:50:52.374169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.385406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14aa3-0318-49d7-83fd-a3a06bab3449 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.392381 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.393191 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.393564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.394032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.394863 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.397192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.430105 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1166/2349] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:52.436326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.453951 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df9cb-aeb2-4c9e-9a60-aea9b0da4fa1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.527693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.528443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.528831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.529197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.530115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.532481 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.564786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1184/2350] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:52.569761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.580715 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad36f-7beb-42c9-ba19-4ab8beff87d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.586705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.587390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.587761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.588247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.588891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.590629 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.604973 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1167/2351] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:52.606204 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.617803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e6ad-3a6f-453a-b3a2-2a0e41b54c92 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.637500 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.638287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.638901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.642007 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.644985 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.646898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e415-0882-4261-9379-eb36ee9c728c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.670379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1185/2352] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:52.671421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:52.688477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7b84-dd48-41ca-ae07-0c81050e1b7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:52.695461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:52.696433 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.696859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.697264 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] PATH_INFO: `/v3/projects/4d73ae808c904ea5a1b79ba77f8b2db8/users/7d4b2a901b8448d6a304b1de218ff6fc/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.739006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d73ae808c904ea5a1b79ba77f8b2db8, user_id=7d4b2a901b8448d6a304b1de218ff6fc, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:52.748557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:52.768839 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1168/2353] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:52 2022] PUT /identity/v3/projects/4d73ae808c904ea5a1b79ba77f8b2db8/users/7d4b2a901b8448d6a304b1de218ff6fc/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:52.781387 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:52.781744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:52.782258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:52.816065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] MFA Rules not processed for user `7d4b2a901b8448d6a304b1de218ff6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:52.817427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:52.898840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1186/2354] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:52.903249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.009910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd916-cf48-4612-89f9-774bfbfc24cc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.015084 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.015704 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.016011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.016373 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.016964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.019054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.060636 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1169/2355] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:52 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:53.062039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.081241 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae44f-500b-416c-92a6-525d9ff0e05c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.103701 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:53.150460 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.151212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.151553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.151929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.152613 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.154654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.178070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1187/2356] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:53 2022] POST /identity/v3/users => generated 302 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:53.182173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.193008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9534f1-e6cb-4a20-b1bc-45f247d37a62 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.198473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.199143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.199460 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.199741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.200484 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.202401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.217833 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1170/2357] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:53.219151 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.230019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366397-7403-4709-acc6-2ccd9a3ea611 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.234730 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.235398 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.235673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.235946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] PATH_INFO: `/v3/projects/3838343896794238bf66cc0707959c26/users/0241766b9a8a4203a4a07764d08ba133/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.253040 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3838343896794238bf66cc0707959c26, user_id=0241766b9a8a4203a4a07764d08ba133, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.255884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.270070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1188/2358] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:53 2022] PUT /identity/v3/projects/3838343896794238bf66cc0707959c26/users/0241766b9a8a4203a4a07764d08ba133/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:53.274747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.286314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8e2b-bc2b-442e-95c9-1fe869e8b64f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.330398 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:53.352942 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.353547 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.353861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.354134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.354819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.356426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1ddc-5377-4c4b-83c7-e6d78d51880e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.367122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1171/2359] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:53.371422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.382643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cec05-8a58-4653-bd0b-dbb16c8151bf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.388181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.388979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.389257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.389532 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] PATH_INFO: `/v3/projects/3838343896794238bf66cc0707959c26/users/0241766b9a8a4203a4a07764d08ba133/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.391825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3838343896794238bf66cc0707959c26, user_id=0241766b9a8a4203a4a07764d08ba133, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.394628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.405729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1189/2360] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:53 2022] PUT /identity/v3/projects/3838343896794238bf66cc0707959c26/users/0241766b9a8a4203a4a07764d08ba133/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:50:53.416321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.416847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.416847 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.446395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] MFA Rules not processed for user `0241766b9a8a4203a4a07764d08ba133`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:53.447593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:53.527379 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1172/2361] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:53.538439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.540497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:53.602494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b5898-9b73-4c25-8d2f-9d7b8fba6689 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.607054 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.607725 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.607999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.608274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.620298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.621948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.633118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1190/2362] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:53.687363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:53.688850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:53.701842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ab76a-71d0-407c-af11-ae349f2a910d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:53.706228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:53.706918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:53.707206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:53.707477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:53.773689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:53.775210 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379686f-6076-4257-8232-de08544b7ae8 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:53.785035 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1173/2363] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:57.296286 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:57.362841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2afc-106d-44e4-a31a-d69dffd874c6 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:57.367907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:57.368591 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:57.368873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:57.369142 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] PATH_INFO: `/v3/users/7d4b2a901b8448d6a304b1de218ff6fc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:57.370506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4b2a901b8448d6a304b1de218ff6fc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:57.372427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:57.404215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:57.437093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4b2a901b8448d6a304b1de218ff6fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:57.448181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4b2a901b8448d6a304b1de218ff6fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:57.469643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4b2a901b8448d6a304b1de218ff6fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:57.474977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4b2a901b8448d6a304b1de218ff6fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:57.484583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4b2a901b8448d6a304b1de218ff6fc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:57.494923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1191/2364] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:57 2022] DELETE /identity/v3/users/7d4b2a901b8448d6a304b1de218ff6fc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:57.499561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:57.500077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:57.500077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:57.530357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:57.531649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:57.601441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1174/2365] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:57.611875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:57.614259 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:57.689192 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731c71d-cc5c-4fe2-aba3-7f4b2d0d64c1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:57.692968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:57.693597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:57.693895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:57.694169 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:57.703450 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:57.705213 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:57.714667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1192/2366] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:50:58.040261 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:58.041872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:58.051189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:58.059423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36470a1-ca28-446d-92b1-f02b4934056b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:58.064248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:58.065221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.065572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.065938 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] PATH_INFO: `/v3/projects/4d73ae808c904ea5a1b79ba77f8b2db8` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.067244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d73ae808c904ea5a1b79ba77f8b2db8)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:58.069198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:58.137765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d73ae808c904ea5a1b79ba77f8b2db8', 'request_id': 'req-620033ba-eeca-4c38-a029-37555eed52f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.148936 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d73ae808c904ea5a1b79ba77f8b2db8', 'request_id': 'req-620033ba-eeca-4c38-a029-37555eed52f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.155453 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d73ae808c904ea5a1b79ba77f8b2db8', 'request_id': 'req-620033ba-eeca-4c38-a029-37555eed52f5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.168122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] The token cache is being invalidate because project 4d73ae808c904ea5a1b79ba77f8b2db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:58.168234 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.169023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.170543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1175/2367] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:58 2022] DELETE /identity/v3/projects/4d73ae808c904ea5a1b79ba77f8b2db8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:58.174693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:58.184651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348d7f-7fe2-427e-9cdf-bab9454de476 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:58.248670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:58.249193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.249474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.249815 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] PATH_INFO: `/v3/users/0241766b9a8a4203a4a07764d08ba133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.251847 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0241766b9a8a4203a4a07764d08ba133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:58.253179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:58.297913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:58.300510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0241766b9a8a4203a4a07764d08ba133'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.309441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0241766b9a8a4203a4a07764d08ba133'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.322505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0241766b9a8a4203a4a07764d08ba133'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.323361 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0241766b9a8a4203a4a07764d08ba133'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.331224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e63e8223-6daf-45be-b1b0-48b7dfc96f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0241766b9a8a4203a4a07764d08ba133'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.338036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1193/2368] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:50:58 2022] DELETE /identity/v3/users/0241766b9a8a4203a4a07764d08ba133 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:58.631665 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:58.633173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:58.647768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620033ba-eeca-4c38-a029-37555eed52f5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:58.709114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:58.709770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.710044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.710311 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] PATH_INFO: `/v3/projects/3838343896794238bf66cc0707959c26` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.711434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3838343896794238bf66cc0707959c26)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:58.713323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:58.763334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3838343896794238bf66cc0707959c26', 'request_id': 'req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.771923 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3838343896794238bf66cc0707959c26', 'request_id': 'req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.777815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3838343896794238bf66cc0707959c26', 'request_id': 'req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.791029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] The token cache is being invalidate because project 3838343896794238bf66cc0707959c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:50:58.791323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.792025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cfc361f4-60a6-4d50-b35e-0ff9482cfb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:50:58.793958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1176/2369] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:50:58 2022] DELETE /identity/v3/projects/3838343896794238bf66cc0707959c26 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:58.798867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.799156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.799430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.821149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:58.822384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:58.884279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1194/2370] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:58.895040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.895247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.895511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.916955 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:58.918198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:58.927803 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1177/2371] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:50:58.932343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:58.942363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8705d04-b833-4dcd-9add-754f42515aee None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:58.947675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:58.948268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.948539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.948802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.949442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:50:58.949774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:58.951369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:58.963289 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1195/2372] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:50:58.968080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:58.982718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9812308-eb44-46ca-9abf-197d3b6dc695 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:58.989434 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:58.990089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:58.990370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:58.990617 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:58.991256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:58.993209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:58.999197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:59.027784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1178/2373] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:58 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:59.029000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.039498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f5d6c-62a6-4af0-8c3c-1db182f38a7b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.114735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.115367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.115654 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.115912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.116537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.118494 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.144411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1196/2374] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:59 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:59.148576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.160209 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c968-f31a-494c-8117-fec790540642 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.166248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.166867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.167129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.167377 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.168096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.169734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.180864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1179/2375] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:59.185393 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.195549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a477e6-6112-4fe1-adc2-80af31feaad8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.200374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.200988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.201263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.201538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.202269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.203940 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca4342-67ca-4d29-8d22-06257c3a88d7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.215349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1197/2376] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:59.219515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.229490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91669db-6b6a-402d-8ddb-123f82012b6c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.235782 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.236614 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.236889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.237158 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] PATH_INFO: `/v3/projects/c033086b0b0b4ecab8b9753054ace9b4/users/71650110cb9542a393ec05329105f072/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.253649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c033086b0b0b4ecab8b9753054ace9b4, user_id=71650110cb9542a393ec05329105f072, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.256417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.270725 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1180/2377] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:59 2022] PUT /identity/v3/projects/c033086b0b0b4ecab8b9753054ace9b4/users/71650110cb9542a393ec05329105f072/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:59.283087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.283371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.283643 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.318355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] MFA Rules not processed for user `71650110cb9542a393ec05329105f072`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:59.319589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:59.334820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:59.389150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1198/2378] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:59.394289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.467883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddb2c-876b-4503-9f60-042ec216248d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.473451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.474182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.474507 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.474824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.475610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.478010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.508772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1181/2379] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:50:59 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:50:59.513519 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.525342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a83f8-8941-4d38-8f7c-2475142ddf8d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.582677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.583271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.583531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.583798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.584427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.586366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.611265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1199/2380] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:50:59 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:50:59.615083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.625750 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de245f-678d-4de6-bf2d-b0b1f751b0e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.631422 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.632029 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.632576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.632576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.633227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.634891 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.646230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1182/2381] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:59.650566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.661042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977cb8-7ef7-48f9-adae-28ce36e199f6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.666721 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.667390 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.667664 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.667932 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] PATH_INFO: `/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4/users/d1ac8b9160ff40729bd7f3d657fda0d2/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.686630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7defd8dd438742caaeb6af9f57a6a9d4, user_id=d1ac8b9160ff40729bd7f3d657fda0d2, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.690069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.707264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1200/2382] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:59 2022] PUT /identity/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4/users/d1ac8b9160ff40729bd7f3d657fda0d2/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:59.711212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.721669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d258-475f-4c13-90cf-2285bbbfefac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.783337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.783950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.784226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.784501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.785138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.786898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58f11-0f6c-494a-9063-fec30b73ffd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.796797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1183/2383] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:50:59.801215 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.812850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f42a9-e429-4deb-8636-744426df9e7e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:50:59.818305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:50:59.818967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.819240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.819509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] PATH_INFO: `/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4/users/d1ac8b9160ff40729bd7f3d657fda0d2/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.821470 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7defd8dd438742caaeb6af9f57a6a9d4, user_id=d1ac8b9160ff40729bd7f3d657fda0d2, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:50:59.824109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:50:59.835252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1201/2384] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:50:59 2022] PUT /identity/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4/users/d1ac8b9160ff40729bd7f3d657fda0d2/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:50:59.845540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:50:59.845851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:50:59.846135 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:50:59.877716 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] MFA Rules not processed for user `d1ac8b9160ff40729bd7f3d657fda0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:50:59.879130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:50:59.890094 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:59.954884 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1184/2385] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:50:59.966848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:50:59.969017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:00.036498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c0d3-467e-42dd-96db-5527b54edfb1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:00.040270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:00.040882 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.041161 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.041435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.050675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:00.052105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:00.061449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1202/2386] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:50:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:00.162649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:00.173091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0fc87-3b91-4b22-9fa0-333c82597beb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:00.177719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:00.178325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.178596 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.179046 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.242260 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:00.243703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:00.254126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1185/2387] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:51:00.551199 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:00.564246 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:00.593674 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:00.595189 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:00.624890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acf7e0-e25e-459c-a147-775828a722f0 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:00.630787 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:00.631568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.632313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.632581 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] PATH_INFO: `/v3/users/71650110cb9542a393ec05329105f072` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.634209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71650110cb9542a393ec05329105f072)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:00.635724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:00.659330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ac5-2256-492a-bd1f-2e2a1849f55c service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:00.664668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:00.665284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.665561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.665866 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.667695 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:00.701647 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71650110cb9542a393ec05329105f072'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:00.720000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71650110cb9542a393ec05329105f072'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:00.746750 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71650110cb9542a393ec05329105f072'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:00.747504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71650110cb9542a393ec05329105f072'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:00.754511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:00.756479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70e8d40e-8c45-4be0-91dc-dcb44b172c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71650110cb9542a393ec05329105f072'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:00.759380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:00.761256 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:00.763719 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1203/2388] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:00 2022] DELETE /identity/v3/users/71650110cb9542a393ec05329105f072 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:00.768144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.768401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.768675 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.772810 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1186/2389] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:51:00.788004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:00.789247 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:00.854130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1204/2390] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:51:00.864393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:00.873625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33467-4ff9-4c96-a823-b7b871ba47a1 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:00.926844 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:00.927461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:00.927728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:00.927996 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:00.937492 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:00.939003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:00.950766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1187/2391] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:01.518078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:01.519607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:01.539855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343492ab-665c-4b02-a4a3-078a311ef93f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:01.547025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:01.548409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:01.548770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:01.549102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] PATH_INFO: `/v3/projects/c033086b0b0b4ecab8b9753054ace9b4` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:01.552302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c033086b0b0b4ecab8b9753054ace9b4)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:01.554357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:01.585999 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:01.605663 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c033086b0b0b4ecab8b9753054ace9b4', 'request_id': 'req-a369b99b-f59e-482f-92bb-6b310466e5da'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.613926 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c033086b0b0b4ecab8b9753054ace9b4', 'request_id': 'req-a369b99b-f59e-482f-92bb-6b310466e5da'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.619609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c033086b0b0b4ecab8b9753054ace9b4', 'request_id': 'req-a369b99b-f59e-482f-92bb-6b310466e5da'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.631009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] The token cache is being invalidate because project c033086b0b0b4ecab8b9753054ace9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:01.631212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.631907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.634032 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1205/2392] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:01 2022] DELETE /identity/v3/projects/c033086b0b0b4ecab8b9753054ace9b4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:51:01.638168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:01.648007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e285-41e6-47c5-93d9-4ecf654a94ab service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:01.705911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:01.706630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:01.706837 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:01.707108 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] PATH_INFO: `/v3/users/d1ac8b9160ff40729bd7f3d657fda0d2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:01.708368 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ac8b9160ff40729bd7f3d657fda0d2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:01.710380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:01.771642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ac8b9160ff40729bd7f3d657fda0d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.772277 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ac8b9160ff40729bd7f3d657fda0d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.780395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ac8b9160ff40729bd7f3d657fda0d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.792806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ac8b9160ff40729bd7f3d657fda0d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.799995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d4e8c8ce-921a-4efc-88f0-931c9d6f63b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ac8b9160ff40729bd7f3d657fda0d2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:01.806898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1188/2393] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:01 2022] DELETE /identity/v3/users/d1ac8b9160ff40729bd7f3d657fda0d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:02.284285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.285867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:02.299435 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369b99b-f59e-482f-92bb-6b310466e5da admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.378477 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.379120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.379399 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.379673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] PATH_INFO: `/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.380805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7defd8dd438742caaeb6af9f57a6a9d4)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.382746 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.435389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7defd8dd438742caaeb6af9f57a6a9d4', 'request_id': 'req-f6997fe3-1c3c-45b5-b622-2db59c62bea8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:02.443469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7defd8dd438742caaeb6af9f57a6a9d4', 'request_id': 'req-f6997fe3-1c3c-45b5-b622-2db59c62bea8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:02.449802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7defd8dd438742caaeb6af9f57a6a9d4', 'request_id': 'req-f6997fe3-1c3c-45b5-b622-2db59c62bea8'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:02.469384 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] The token cache is being invalidate because project 7defd8dd438742caaeb6af9f57a6a9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:02.470022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:02.470683 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f6997fe3-1c3c-45b5-b622-2db59c62bea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:02.473017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1206/2394] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:02 2022] DELETE /identity/v3/projects/7defd8dd438742caaeb6af9f57a6a9d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:51:02.477764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.478054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.478378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.499557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:02.500861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:02.513872 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:02.571375 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1189/2395] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:02.580402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.580954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.580954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.603501 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:02.604895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:02.614328 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1207/2396] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:02.618537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.629213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb51a1-0586-4f65-aad5-bb85224ec1a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.634638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.635615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.635615 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.635814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.636495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:51:02.636746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.638710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.654138 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1190/2397] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:51:02.658554 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.671530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffae15-3763-4992-a7ab-c9ec4ae3238e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.680993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.681762 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.681972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.682267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.682952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.684901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.722461 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1208/2398] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:02.726869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.738246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473927d-5697-45ec-86ba-cbb92d91283a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.846688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.847226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.847509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.847768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.848420 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.850723 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.882317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1191/2399] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:51:02 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:51:02.883843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.899468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe799-6a66-4084-ad9f-cd26d93d90e0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.904625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.905479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.905945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.907568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.908412 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.910442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.922272 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1209/2400] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:02.927607 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.940279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae20b0-b717-4651-b4c1-046f1d40eb64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.946291 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.946924 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.947199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.947472 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:02.948486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:02.950278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:02.962689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1192/2401] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:02.967498 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.975817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:02.979735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32119a92-0df3-4f19-9281-69340ef35b31 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:02.988424 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:02.989556 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:02.991040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:02.992934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:02.994601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:02.995091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] PATH_INFO: `/v3/projects/532d1178021b4e7ab42fa378a05b3d6e/users/caa3b491683042eebaf9ad19bb7f0244/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.012134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532d1178021b4e7ab42fa378a05b3d6e, user_id=caa3b491683042eebaf9ad19bb7f0244, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.015386 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed64356-0cbd-4c6a-944c-8680eb8e2eb0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.034625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1210/2402] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:02 2022] PUT /identity/v3/projects/532d1178021b4e7ab42fa378a05b3d6e/users/caa3b491683042eebaf9ad19bb7f0244/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:03.045267 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.045547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.046382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.098051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] MFA Rules not processed for user `caa3b491683042eebaf9ad19bb7f0244`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:03.100025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:03.103251 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb90c-df7d-4103-9dad-61851762b43d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.130483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:03.216214 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1211/2403] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:51:03.221302 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.234814 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4de9ba564044ab8a8f835faae23ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.235986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.236116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.236600 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.239338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:03.255310 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.257421 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.272602 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1193/2404] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:03.307686 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42ed55-8068-40f8-86de-e93c0a6ecd1f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.314254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.315405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.315657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.315937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.316625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.318791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.355821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1212/2405] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:03.357147 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.370835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78a3aa-e37f-4b6d-a6b8-add3cb83062d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.470692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.471576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.472007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.472429 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.473488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.475788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.501907 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1194/2406] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:03.511732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.524485 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5d28-7f9c-4f7f-b0ad-0156fe976462 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.529397 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.530316 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.530680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.530992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.532505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.534249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.547943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1213/2407] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:03.551852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.563625 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15e41a-29fa-4927-bcbf-5835727b3d7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.568642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.569269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.569656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.569949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.570663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.572287 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8da9a-5d97-48c3-9d7e-e2798373ae5f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.583249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1195/2408] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:03.588240 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.601010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d73d6-81ea-46b1-a741-530e03e2afd6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.608211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.608924 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.610124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.610542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] PATH_INFO: `/v3/projects/666c29944cb7427ea8e0f1a32847c1bf/users/6767456d7d1b4dd2862e30c9bf0c54b7/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.632939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=666c29944cb7427ea8e0f1a32847c1bf, user_id=6767456d7d1b4dd2862e30c9bf0c54b7, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.635570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.651752 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1214/2409] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:03 2022] PUT /identity/v3/projects/666c29944cb7427ea8e0f1a32847c1bf/users/6767456d7d1b4dd2862e30c9bf0c54b7/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:03.662395 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.662746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.663070 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.694197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] MFA Rules not processed for user `6767456d7d1b4dd2862e30c9bf0c54b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:03.695493 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:03.781620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1196/2410] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:03.784347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.809517 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:03.863057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8effb1-d354-45ca-89a2-4a05dc1b7caf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.868341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:03.868974 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:03.869258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:03.870039 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:03.870254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:03.872180 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:03.902509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1215/2411] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:03.907308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:03.922283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fae21-07a7-4f78-b0f3-71d4fa493a67 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:03.936843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:04.000407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.000407 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.001232 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.002193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.002857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.005027 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.048293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:04.055049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1197/2412] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:51:03 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:04.059621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0576d8-3d19-4649-8419-e20dd0d3f8ba admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:04.064343 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.065110 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.065392 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.065700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.066529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.068230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.086266 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1216/2413] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:04.086969 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:04.100446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be87eb7-6a67-40a1-a210-304176a93790 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:04.115479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.116369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.116690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.117043 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] PATH_INFO: `/v3/projects/1c511165afa34056beb0c475851cec1d/users/225dd0b891284cf0a1df0bdcad771756/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.150630 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c511165afa34056beb0c475851cec1d, user_id=225dd0b891284cf0a1df0bdcad771756, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.153540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.175181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1198/2414] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:04 2022] PUT /identity/v3/projects/1c511165afa34056beb0c475851cec1d/users/225dd0b891284cf0a1df0bdcad771756/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:51:04.179576 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:04.195249 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d63dc-4c77-43d5-9d15-8505d6d21632 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:04.269111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.269910 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.270193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.270466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.271111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.272703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580e658-98c4-42b1-b510-895dc897723a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.284982 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1217/2415] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:04.289247 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:04.299581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a647-d1bd-4dfc-bb6d-b2fa4b76f4f2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:04.304516 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.305218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.305498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.305822 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] PATH_INFO: `/v3/projects/1c511165afa34056beb0c475851cec1d/users/225dd0b891284cf0a1df0bdcad771756/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.307776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c511165afa34056beb0c475851cec1d, user_id=225dd0b891284cf0a1df0bdcad771756, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.310527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.321768 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1199/2416] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:04 2022] PUT /identity/v3/projects/1c511165afa34056beb0c475851cec1d/users/225dd0b891284cf0a1df0bdcad771756/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:04.392326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.392645 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.392920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.433938 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] MFA Rules not processed for user `225dd0b891284cf0a1df0bdcad771756`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:04.435273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:04.516590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1218/2417] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:04.529196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:04.531076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:04.592360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6593e9-765f-4d97-b55d-3399ae85cf50 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:04.597089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:04.597740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:04.598015 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:04.598280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:04.679111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:04.680580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:04.691062 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1200/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:06.323063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:06.324744 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:06.340074 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfe57-9597-4004-b1de-3cb3533e1bbe None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:06.344507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:06.345121 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:06.345538 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:06.345863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:06.359077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:06.411809 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:06.414083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:06.424449 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1219/2419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:07.002360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:07.011423 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fcc18-a3ab-4ebe-91cf-3f8a929ed038 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:07.015321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:07.016003 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:07.016282 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:07.016556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:07.026443 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:07.027911 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d6f0-a621-4f54-a8ca-2367425f39ad service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:07.039196 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1201/2420] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:11.042431 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:11.123016 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea475-8043-467c-9fd6-d05f4df2e9c9 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:11.130277 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:11.131138 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:11.131514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:11.131920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] PATH_INFO: `/v3/users/caa3b491683042eebaf9ad19bb7f0244` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:11.133684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa3b491683042eebaf9ad19bb7f0244)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:11.136395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:11.196197 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa3b491683042eebaf9ad19bb7f0244'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.208474 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa3b491683042eebaf9ad19bb7f0244'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.224704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa3b491683042eebaf9ad19bb7f0244'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.225599 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa3b491683042eebaf9ad19bb7f0244'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.236864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa3b491683042eebaf9ad19bb7f0244'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.244506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1220/2421] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:11 2022] DELETE /identity/v3/users/caa3b491683042eebaf9ad19bb7f0244 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:11.249746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:11.250561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:11.250561 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:11.273049 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:11.274275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:11.278669 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:11.338610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1202/2422] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:11.350364 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:11.352795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:11.397549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:11.431873 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663d31-0d01-45d4-acea-b8db1a0227d2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:11.437917 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:11.438529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:11.438805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:11.439075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:11.449890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:11.451327 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:11.462165 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1221/2423] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:11.784239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:11.785845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:11.799065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff999-21c1-434f-b5ab-b8e9fdac7df4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:11.804755 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:11.805439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:11.805683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:11.805974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] PATH_INFO: `/v3/projects/532d1178021b4e7ab42fa378a05b3d6e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:11.807285 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532d1178021b4e7ab42fa378a05b3d6e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:11.809297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:11.862724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532d1178021b4e7ab42fa378a05b3d6e', 'request_id': 'req-05fdfe01-fab3-4753-aaf9-124f6d671406'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.871871 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532d1178021b4e7ab42fa378a05b3d6e', 'request_id': 'req-05fdfe01-fab3-4753-aaf9-124f6d671406'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.878361 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532d1178021b4e7ab42fa378a05b3d6e', 'request_id': 'req-05fdfe01-fab3-4753-aaf9-124f6d671406'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.890851 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] The token cache is being invalidate because project 532d1178021b4e7ab42fa378a05b3d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:11.891087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.891688 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:11.893334 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1203/2424] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:11 2022] DELETE /identity/v3/projects/532d1178021b4e7ab42fa378a05b3d6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:11.897514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:11.908300 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc653a1-1b5d-4653-9ba0-6962d1659dcd service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:11.976388 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:11.976927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:11.977200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:11.977459 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] PATH_INFO: `/v3/users/6767456d7d1b4dd2862e30c9bf0c54b7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:11.978633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6767456d7d1b4dd2862e30c9bf0c54b7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:11.980542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:12.033553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6767456d7d1b4dd2862e30c9bf0c54b7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.043507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6767456d7d1b4dd2862e30c9bf0c54b7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.061322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6767456d7d1b4dd2862e30c9bf0c54b7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.061322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6767456d7d1b4dd2862e30c9bf0c54b7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.064144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6767456d7d1b4dd2862e30c9bf0c54b7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.070363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1222/2425] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:11 2022] DELETE /identity/v3/users/6767456d7d1b4dd2862e30c9bf0c54b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:51:12.363659 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:12.365117 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:12.380184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdfe01-fab3-4753-aaf9-124f6d671406 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:12.448825 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:12.449495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:12.449848 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:12.450080 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] PATH_INFO: `/v3/projects/666c29944cb7427ea8e0f1a32847c1bf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:12.451274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] RBAC: Authorizing `identity:delete_project(project_id=666c29944cb7427ea8e0f1a32847c1bf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:12.453722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:12.496089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:12.508183 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666c29944cb7427ea8e0f1a32847c1bf', 'request_id': 'req-70848662-1ad2-4867-a850-5ae6ae2f628f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.516401 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666c29944cb7427ea8e0f1a32847c1bf', 'request_id': 'req-70848662-1ad2-4867-a850-5ae6ae2f628f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.522439 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666c29944cb7427ea8e0f1a32847c1bf', 'request_id': 'req-70848662-1ad2-4867-a850-5ae6ae2f628f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.535983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] The token cache is being invalidate because project 666c29944cb7427ea8e0f1a32847c1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:12.536255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.536995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.538644 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1204/2426] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:12 2022] DELETE /identity/v3/projects/666c29944cb7427ea8e0f1a32847c1bf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:51:12.542996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:12.544870 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:12.559427 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0580f-13b1-4efd-b5e8-741b0e11e2e7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:12.613911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:12.621603 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:12.622476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:12.623243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:12.623697 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] PATH_INFO: `/v3/users/225dd0b891284cf0a1df0bdcad771756` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:12.625015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] RBAC: Authorizing `identity:delete_user(user_id=225dd0b891284cf0a1df0bdcad771756)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:12.627369 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:12.677173 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225dd0b891284cf0a1df0bdcad771756'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.686193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225dd0b891284cf0a1df0bdcad771756'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.699053 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225dd0b891284cf0a1df0bdcad771756'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.699781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225dd0b891284cf0a1df0bdcad771756'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.707378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-75fb486e-6780-4468-8641-3fac7773871a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225dd0b891284cf0a1df0bdcad771756'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:12.713548 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1223/2427] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:12 2022] DELETE /identity/v3/users/225dd0b891284cf0a1df0bdcad771756 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:12.998835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.000573 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:13.020077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848662-1ad2-4867-a850-5ae6ae2f628f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.080557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.081190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.081465 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.081772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] PATH_INFO: `/v3/projects/1c511165afa34056beb0c475851cec1d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.082882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c511165afa34056beb0c475851cec1d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.084794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.134473 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c511165afa34056beb0c475851cec1d', 'request_id': 'req-164a11bf-ffd1-41ec-855c-8cdb2ead02af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:13.143031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c511165afa34056beb0c475851cec1d', 'request_id': 'req-164a11bf-ffd1-41ec-855c-8cdb2ead02af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:13.149032 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c511165afa34056beb0c475851cec1d', 'request_id': 'req-164a11bf-ffd1-41ec-855c-8cdb2ead02af'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:13.160761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] The token cache is being invalidate because project 1c511165afa34056beb0c475851cec1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:13.161051 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:13.161802 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-164a11bf-ffd1-41ec-855c-8cdb2ead02af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:13.163385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1205/2428] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:12 2022] DELETE /identity/v3/projects/1c511165afa34056beb0c475851cec1d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:13.169823 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.170322 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.170536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.192105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:13.193342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:13.258336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1224/2429] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:13.266690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.266962 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.267227 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.287471 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:13.288576 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:13.296774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1206/2430] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:13.301278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.312034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b435c-edb8-4165-9528-8a7ef804dcd3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.317031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.317659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.317935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.318208 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.318872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:51:13.319154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.320735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.333209 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1225/2431] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:51:13.337620 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.347456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fbc0b-702f-4075-a794-e4e50025cc29 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.353201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.353852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.354123 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.354369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.354992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.356913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.390174 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1207/2432] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:51:13 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:51:13.394509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.404853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522accbb-4b97-4423-8d81-21a2d3a4667f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.467443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.468120 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.468661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.468976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.469705 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.471733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.481060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:13.497371 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1226/2433] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:51:13 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:51:13.502053 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.513914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64cb09-48a3-4947-82a7-c69576f495fc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.520149 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.520767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.521038 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.521302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.522082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.523691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.534685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1208/2434] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:13.539884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.551514 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d596-8c09-4687-bcd6-006cd9cfa6ae admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.556041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.556650 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.556925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.557194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.557871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.559453 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfc2b0-fcea-4b8a-9a76-124dfd55592f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.570770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1227/2435] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:13.575577 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.586067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29bcce-8a19-4563-a133-6e65a2d4187d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.591036 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.591784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.592155 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.592548 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] PATH_INFO: `/v3/projects/d7cf6d09a0d24e2a973930e13a70de00/users/d40992e618af4662a5405a9475f36086/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.605179 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:13.611058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf6d09a0d24e2a973930e13a70de00, user_id=d40992e618af4662a5405a9475f36086, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.614628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.629006 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1209/2436] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:13 2022] PUT /identity/v3/projects/d7cf6d09a0d24e2a973930e13a70de00/users/d40992e618af4662a5405a9475f36086/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:13.641380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.641678 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.641980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.674264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] MFA Rules not processed for user `d40992e618af4662a5405a9475f36086`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:13.675505 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:13.748542 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1228/2437] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:13.762180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:13.764143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:13.831542 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d574-d53d-4b76-a82b-387ad58ba422 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:13.835485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:13.836097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:13.836432 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:13.836611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:13.852369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:13.853867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0d8f7-05e3-42d5-bbaa-4f2368b188a3 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:13.865106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1210/2438] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:16.513189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:16.581803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cb45f-4b45-42e2-934e-8eae6e98acec None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:16.586676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:16.587311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:16.587590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:16.587862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] PATH_INFO: `/v3/users/d40992e618af4662a5405a9475f36086` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:16.589000 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40992e618af4662a5405a9475f36086)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:16.590960 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:16.642832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40992e618af4662a5405a9475f36086'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:16.651747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40992e618af4662a5405a9475f36086'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:16.664125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40992e618af4662a5405a9475f36086'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:16.664757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40992e618af4662a5405a9475f36086'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:16.666006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:16.673642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40992e618af4662a5405a9475f36086'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:16.680590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1229/2439] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:16 2022] DELETE /identity/v3/users/d40992e618af4662a5405a9475f36086 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:16.685075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:16.685550 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:16.685693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:16.706111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:16.707328 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:16.772637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1211/2440] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:16.784323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:16.785947 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:16.844981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df88e37-cd77-4b66-8315-e3faf5f4ab93 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:16.848783 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:16.849441 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:16.849753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:16.850065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:16.859421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:16.860844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d772f-2b43-444e-930f-a055352e4008 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:16.870811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1230/2441] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:17.156933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.158417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:17.172902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8a7e0-2c4a-461b-b684-62db752d5205 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.178824 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.180060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.180537 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.180808 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] PATH_INFO: `/v3/projects/d7cf6d09a0d24e2a973930e13a70de00` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.182067 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cf6d09a0d24e2a973930e13a70de00)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.183972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.235228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cf6d09a0d24e2a973930e13a70de00', 'request_id': 'req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:17.244975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cf6d09a0d24e2a973930e13a70de00', 'request_id': 'req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:17.251508 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cf6d09a0d24e2a973930e13a70de00', 'request_id': 'req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:17.263218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] The token cache is being invalidate because project d7cf6d09a0d24e2a973930e13a70de00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:17.263512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:17.264177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4d4a7c12-6422-4ea6-b9d2-eaf6b07b3cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:17.266142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1212/2442] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:17 2022] DELETE /identity/v3/projects/d7cf6d09a0d24e2a973930e13a70de00 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:17.271058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.271339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.271623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.292036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:17.293336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:17.360166 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1231/2443] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:17.368729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.369022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.369327 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.391930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:17.393133 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:17.401590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1213/2444] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:17.406144 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.416325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cd24b-0fc8-4d9c-8bd2-5deef13fd094 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.421905 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.422510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.422780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.423046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.423692 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:51:17.423992 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.425590 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.437856 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1232/2445] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:51:17.442199 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.451974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17d1a-4aba-4bf0-a4e7-b21e04745e38 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.458608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.459308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.459655 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.460011 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.460778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.462796 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.468828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:17.495417 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1214/2446] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:51:17 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:51:17.500536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.510791 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09be8-54a6-47d3-aceb-9836f1f2f19c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.580753 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.581419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.581609 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.582100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.582732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.584633 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.609440 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1233/2447] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:51:17 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:51:17.616074 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.626881 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e637af-81d1-441f-a857-5e98a9888ba4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.632262 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.632862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.633134 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.633431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.634106 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.635706 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.646076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1215/2448] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:17.650279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.661171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35530b57-a75f-46d8-9e2b-54c2e94c650b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.666660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.667261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.667539 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.667810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.668465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.670091 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be8ef0-e4be-4c8b-9d86-35e295c956c3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.672534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:17.685534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1234/2449] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:51:17.686804 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.697146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd272f2-3c9c-4b2f-b1c2-86541a177c55 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.703552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.704271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.704590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.704940 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] PATH_INFO: `/v3/projects/a961c15e11ef46f79eb6781f929129c9/users/800d5c8b07e84132af9c352cef5ae1df/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.725406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a961c15e11ef46f79eb6781f929129c9, user_id=800d5c8b07e84132af9c352cef5ae1df, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.729643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.751329 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1216/2450] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:51:17 2022] PUT /identity/v3/projects/a961c15e11ef46f79eb6781f929129c9/users/800d5c8b07e84132af9c352cef5ae1df/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:17.761868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.762155 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.762432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.795774 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] MFA Rules not processed for user `800d5c8b07e84132af9c352cef5ae1df`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:17.797149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:17.873465 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1235/2451] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:17.885047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:17.887125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:17.949512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c870e-0219-4387-ad41-905cd57feae2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:17.954269 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:17.954873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:17.955152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:17.955435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:17.964699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:17.966206 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780c52-5dc8-4c6c-a556-7caedc611965 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:17.975656 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1217/2452] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:27.869415 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=33 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:27.971569 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:49.447874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:49.571979 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb722e-1b0b-4f92-bd68-fff7660111c2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:49.576631 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:49.577282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:49.577529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:49.577826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] PATH_INFO: `/v3/users/800d5c8b07e84132af9c352cef5ae1df` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:49.578943 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d5c8b07e84132af9c352cef5ae1df)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:49.580824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:49.637677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d5c8b07e84132af9c352cef5ae1df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:49.646958 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d5c8b07e84132af9c352cef5ae1df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:49.663840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d5c8b07e84132af9c352cef5ae1df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:49.664652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d5c8b07e84132af9c352cef5ae1df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:49.672918 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d5c8b07e84132af9c352cef5ae1df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:49.679504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1236/2453] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:51:49 2022] DELETE /identity/v3/users/800d5c8b07e84132af9c352cef5ae1df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:49.684170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:49.684667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:49.684789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:49.741681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:49.742980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:49.811362 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1218/2454] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:51:49.822212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:49.823929 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:49.870245 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:49.906772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e7ae-a84c-439b-8cbe-ec52f4545f23 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:49.910487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:49.911085 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:49.911360 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:49.911625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:49.920987 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:49.922469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:49.932839 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1237/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:50.218202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:50.219815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:50.239136 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddc91c-efba-47ea-915c-256da018a97f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:50.247385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:50.247925 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:50.248304 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:50.248458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] PATH_INFO: `/v3/projects/a961c15e11ef46f79eb6781f929129c9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:50.249672 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a961c15e11ef46f79eb6781f929129c9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:50.251586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:50.302148 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a961c15e11ef46f79eb6781f929129c9', 'request_id': 'req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:50.310700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a961c15e11ef46f79eb6781f929129c9', 'request_id': 'req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:50.316631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a961c15e11ef46f79eb6781f929129c9', 'request_id': 'req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:50.328944 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] The token cache is being invalidate because project a961c15e11ef46f79eb6781f929129c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:51:50.329332 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:50.330132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:51:50.331861 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1219/2456] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:51:50 2022] DELETE /identity/v3/projects/a961c15e11ef46f79eb6781f929129c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:51:50.382195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:50.384170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:50.398543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad294f-e221-408c-a872-13c58c63a0b8 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:50.473482 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:50.474433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:50.474837 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:50.475617 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:50.477807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:50.490933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:50.492553 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6c62-4a53-4930-8a5f-4ed02db7ce5f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:50.503135 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1238/2457] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:50.588019 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:51:50.589727 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:50.603394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0a4ec-d4e3-445a-a84e-0787a2a02c1a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:51:50.607320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:51:50.608007 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:50.609567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:50.609567 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:50.611040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:50.671119 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:51:50.706767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:51:50.708315 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:51:50.744594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1220/2458] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:51:57.643337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f86a-fc7e-41c7-aef0-0c754801f08f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:51:57.643844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f86a-fc7e-41c7-aef0-0c754801f08f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:51:57.643844 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f86a-fc7e-41c7-aef0-0c754801f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:51:57.664797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1648f86a-fc7e-41c7-aef0-0c754801f08f None None] MFA Rules not processed for user `ea25f4ca5bb841a8a7a766d8f9252007`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:51:57.666048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1648f86a-fc7e-41c7-aef0-0c754801f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:51:57.726925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1239/2459] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:51:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:52:00.741064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=20 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:07.719395 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=67 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:31.582767 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:31.584376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:31.684773 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b32ce-b599-4608-93df-5a7b11fb9be8 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:31.690126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:31.690743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:31.691021 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:31.691290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:31.693231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:31.706192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:31.708089 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:31.719435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1221/2460] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:52:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:52:33.515355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:33.515872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:33.515872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:33.545854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] MFA Rules not processed for user `8b098d9fac6d480490d75473398369c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:52:33.547051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:33.618673 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1240/2461] 10.222.0.62 () {58 vars in 967 bytes} [Mon Oct 17 17:52:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:52:33.671692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:33.673813 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:33.747880 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d35bde-98a3-4bcb-9404-a5df470f5587 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:33.753595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33fc4dc7ed74e7bb07e5746aa17e254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:33.754231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:33.754677 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:33.754952 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:33.763759 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:33.765367 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:33.774022 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1222/2462] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Oct 17 17:52:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 17:52:40.737269 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:40.739487 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:40.818586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1540b-9a8b-4362-a551-817f717df18f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:40.823405 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:40.824043 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:40.824293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:40.824569 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] PATH_INFO: `/v3/users/20bd1ac9a20c4106bd8fdf2586955b0f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:40.825786 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bd1ac9a20c4106bd8fdf2586955b0f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:40.827709 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:40.877456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bd1ac9a20c4106bd8fdf2586955b0f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:40.885768 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bd1ac9a20c4106bd8fdf2586955b0f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:40.897925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bd1ac9a20c4106bd8fdf2586955b0f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:40.898585 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bd1ac9a20c4106bd8fdf2586955b0f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:40.905418 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bd1ac9a20c4106bd8fdf2586955b0f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:40.911379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1241/2463] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:52:40 2022] DELETE /identity/v3/users/20bd1ac9a20c4106bd8fdf2586955b0f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:52:41.097776 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:41.108663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c57a8-f8dc-4ebd-9efe-29ffb5e824f9 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:41.171579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:41.172211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:41.172511 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:41.172788 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] PATH_INFO: `/v3/projects/dca5d3423615455aa4a2321776e508d6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:41.174096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca5d3423615455aa4a2321776e508d6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:41.176109 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:41.177718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:41.227520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca5d3423615455aa4a2321776e508d6', 'request_id': 'req-3fe01237-0efa-497c-ad41-7e40bfa7e42a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.236981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca5d3423615455aa4a2321776e508d6', 'request_id': 'req-3fe01237-0efa-497c-ad41-7e40bfa7e42a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.243689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca5d3423615455aa4a2321776e508d6', 'request_id': 'req-3fe01237-0efa-497c-ad41-7e40bfa7e42a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.255638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] The token cache is being invalidate because project dca5d3423615455aa4a2321776e508d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:52:41.255928 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.256666 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.258514 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1223/2464] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:52:41 2022] DELETE /identity/v3/projects/dca5d3423615455aa4a2321776e508d6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:52:41.263428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:41.264822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:41.278676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902e4b-213b-4a2c-8c64-70068cd72ae8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:41.291679 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:41.339715 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:41.340429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:41.340704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:41.340969 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] PATH_INFO: `/v3/users/e37084aad63f43d8b6644b5ae67c9f72` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:41.342287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37084aad63f43d8b6644b5ae67c9f72)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:41.344222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:41.398927 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37084aad63f43d8b6644b5ae67c9f72'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.408479 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37084aad63f43d8b6644b5ae67c9f72'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.420841 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37084aad63f43d8b6644b5ae67c9f72'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.421497 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37084aad63f43d8b6644b5ae67c9f72'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.428651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bda1908a-b260-4ffa-b4f1-5cbf7c2eec7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37084aad63f43d8b6644b5ae67c9f72'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.434931 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1242/2465] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:52:41 2022] DELETE /identity/v3/users/e37084aad63f43d8b6644b5ae67c9f72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:52:41.609026 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:52:41.610811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:41.624198 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01237-0efa-497c-ad41-7e40bfa7e42a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:52:41.688246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:52:41.688896 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:41.689171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:41.689441 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] PATH_INFO: `/v3/projects/c25357cc67424c51a4fd8a545291160c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:41.690657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25357cc67424c51a4fd8a545291160c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:52:41.692711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:52:41.740987 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25357cc67424c51a4fd8a545291160c', 'request_id': 'req-9adc852a-a6de-4fe8-9c32-685d613d5c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.751275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25357cc67424c51a4fd8a545291160c', 'request_id': 'req-9adc852a-a6de-4fe8-9c32-685d613d5c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.757496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25357cc67424c51a4fd8a545291160c', 'request_id': 'req-9adc852a-a6de-4fe8-9c32-685d613d5c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.768994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] The token cache is being invalidate because project c25357cc67424c51a4fd8a545291160c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:52:41.769280 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.770030 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:52:41.771586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1224/2466] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:52:41 2022] DELETE /identity/v3/projects/c25357cc67424c51a4fd8a545291160c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:52:51.431268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:51.765885 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:52:57.877201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:52:57.877802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:52:57.877802 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:52:57.897840 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] MFA Rules not processed for user `ea25f4ca5bb841a8a7a766d8f9252007`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:52:57.899055 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:52:57.956564 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1243/2467] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:52:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:53:07.948551 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=25 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:26.744556 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:26.746163 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:26.810598 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc852a-a6de-4fe8-9c32-685d613d5c58 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:26.815685 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:26.816330 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:26.816604 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:26.816869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] PATH_INFO: `/v3/users/c4eced68406241059405addb8837844f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:26.818047 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4eced68406241059405addb8837844f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:26.819990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:26.874290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4eced68406241059405addb8837844f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:26.874899 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4eced68406241059405addb8837844f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:26.883637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4eced68406241059405addb8837844f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:26.897469 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4eced68406241059405addb8837844f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:26.904772 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4eced68406241059405addb8837844f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:26.910890 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1225/2468] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:53:26 2022] DELETE /identity/v3/users/c4eced68406241059405addb8837844f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:53:27.089256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:27.101181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff310c-8431-46de-b60c-eeefd9bc61d7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:27.162825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:27.163407 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:27.163685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:27.163955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] PATH_INFO: `/v3/projects/ed42902f443f49afa11c021fa64c6943` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:27.165094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed42902f443f49afa11c021fa64c6943)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:27.167077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:27.223274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed42902f443f49afa11c021fa64c6943', 'request_id': 'req-d42c141a-0e28-4310-8024-492a2c59281e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.231483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed42902f443f49afa11c021fa64c6943', 'request_id': 'req-d42c141a-0e28-4310-8024-492a2c59281e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.237936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed42902f443f49afa11c021fa64c6943', 'request_id': 'req-d42c141a-0e28-4310-8024-492a2c59281e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.249530 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] The token cache is being invalidate because project ed42902f443f49afa11c021fa64c6943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:53:27.249850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.250585 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.252181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1244/2469] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:53:27 2022] DELETE /identity/v3/projects/ed42902f443f49afa11c021fa64c6943 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:53:27.256288 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:27.257967 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:27.272690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2312-1373-48e0-b324-9118b207da5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:27.332139 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:27.332771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:27.333088 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:27.333357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] PATH_INFO: `/v3/users/5e1ee93f4f014fa7adeb8036ea24bdd7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:27.334549 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1ee93f4f014fa7adeb8036ea24bdd7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:27.336496 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:27.358690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:27.385809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1ee93f4f014fa7adeb8036ea24bdd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.386728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1ee93f4f014fa7adeb8036ea24bdd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.395034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1ee93f4f014fa7adeb8036ea24bdd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.407239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1ee93f4f014fa7adeb8036ea24bdd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.414769 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1ee93f4f014fa7adeb8036ea24bdd7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.421240 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1226/2470] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:53:27 2022] DELETE /identity/v3/users/5e1ee93f4f014fa7adeb8036ea24bdd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:53:27.603726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:27.605644 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:27.624900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c141a-0e28-4310-8024-492a2c59281e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:27.683821 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:27.684378 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:27.684684 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:27.684950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] PATH_INFO: `/v3/projects/3f99d0144c41480d8a3db64e2d4b1617` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:27.686193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f99d0144c41480d8a3db64e2d4b1617)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:27.688143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:27.728868 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:27.742468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f99d0144c41480d8a3db64e2d4b1617', 'request_id': 'req-d5d70db1-47e7-428b-a9da-f3c113ed23bb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.750638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f99d0144c41480d8a3db64e2d4b1617', 'request_id': 'req-d5d70db1-47e7-428b-a9da-f3c113ed23bb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.758920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f99d0144c41480d8a3db64e2d4b1617', 'request_id': 'req-d5d70db1-47e7-428b-a9da-f3c113ed23bb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.771490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] The token cache is being invalidate because project 3f99d0144c41480d8a3db64e2d4b1617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:53:27.771780 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.772492 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:53:27.774145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1245/2471] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:53:27 2022] DELETE /identity/v3/projects/3f99d0144c41480d8a3db64e2d4b1617 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:53:37.417736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:37.768733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:44.426284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:44.427951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:44.514510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ccaf6-87a6-4966-89b6-2848c9903287 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:44.566005 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:44.566526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:44.566818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:44.567076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:44.568889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:44.651552 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:44.653223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:44.664999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1227/2472] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:53:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:53:46.297143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:53:46.298703 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:46.312370 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70db1-47e7-428b-a9da-f3c113ed23bb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:53:46.316711 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:53:46.317406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:53:46.317748 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:53:46.318069 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:53:46.320024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:53:46.335879 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:53:46.337319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:53:46.350014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1246/2473] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:53:54.659475 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=83 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:53:56.344454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:00.227470 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:00.229040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:00.301501 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e158-6d4e-4d83-9977-4c11333751ac service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:00.307271 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:00.308513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.308791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.309066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] PATH_INFO: `/v3/users/ea25f4ca5bb841a8a7a766d8f9252007` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.310390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea25f4ca5bb841a8a7a766d8f9252007)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:00.312380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:00.362564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea25f4ca5bb841a8a7a766d8f9252007'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.363225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea25f4ca5bb841a8a7a766d8f9252007'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.371778 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea25f4ca5bb841a8a7a766d8f9252007'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.384457 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea25f4ca5bb841a8a7a766d8f9252007'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.391876 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93daad46-57d9-47e2-b9c2-c7f204886b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea25f4ca5bb841a8a7a766d8f9252007'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.397982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1228/2474] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:00 2022] DELETE /identity/v3/users/ea25f4ca5bb841a8a7a766d8f9252007 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:00.578100 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:00.592232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4d0de-1e3d-4060-b4f6-770f70c62953 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:00.658123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:00.658851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.659130 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.659402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] PATH_INFO: `/v3/projects/f9ba4d6ea4114a8b85fc49f9d11f0345` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.660527 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ba4d6ea4114a8b85fc49f9d11f0345)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:00.662488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:00.715884 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ba4d6ea4114a8b85fc49f9d11f0345', 'request_id': 'req-14b25496-f390-4a4f-ac1f-a044218bb713'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.724923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ba4d6ea4114a8b85fc49f9d11f0345', 'request_id': 'req-14b25496-f390-4a4f-ac1f-a044218bb713'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.732525 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ba4d6ea4114a8b85fc49f9d11f0345', 'request_id': 'req-14b25496-f390-4a4f-ac1f-a044218bb713'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.745030 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] The token cache is being invalidate because project f9ba4d6ea4114a8b85fc49f9d11f0345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:00.745363 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.746319 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-14b25496-f390-4a4f-ac1f-a044218bb713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:00.747968 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1247/2475] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:00 2022] DELETE /identity/v3/projects/f9ba4d6ea4114a8b85fc49f9d11f0345 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:00.753326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.753608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.753883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.803651 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:00.804895 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:00.854263 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:00.868125 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1229/2476] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:00.877002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.877285 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.877558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.899078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:00.900226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:00.908722 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1248/2477] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:00.913643 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:00.927121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4bdf4-0c2d-4110-9b8d-db0ffbb99e7b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:00.935176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:00.935789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.936069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.936338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.936990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:00.937305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:00.938966 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:00.952164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1230/2478] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:00.956540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:00.967134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84e783-e4da-4b56-9311-3e216914f74f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:00.972876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:00.973552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:00.973897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:00.974187 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:00.974871 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:00.976963 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.019334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1249/2479] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:00 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:54:01.023997 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.035494 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3898e-7a29-4f95-895f-4a7cb64195b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.096828 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.097438 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.097756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.098033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.098668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.100597 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.124342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1231/2480] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:01 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:01.128658 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.141038 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef963a-73d4-40af-8ecc-41cb6ce11964 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.146796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.147463 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.147767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.148077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.148792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.150659 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.162946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1250/2481] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:01.167726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.178835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6571-94eb-41a5-8876-268c4dbbe7bc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.184720 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.185349 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.185663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.185934 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.186580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.188239 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5bae-7724-40f6-bfe4-4b59ee52bd0d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.200505 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1232/2482] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:01.204937 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.216773 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdca89-b13b-433e-b9e7-4761ce0513da admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.222672 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.223391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.223784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.224104 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] PATH_INFO: `/v3/projects/38f11033b11442afa925a7e89f227a80/users/c479530385cc426180b4cbda65ea6bab/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.241454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f11033b11442afa925a7e89f227a80, user_id=c479530385cc426180b4cbda65ea6bab, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.244129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.259852 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1251/2483] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:01 2022] PUT /identity/v3/projects/38f11033b11442afa925a7e89f227a80/users/c479530385cc426180b4cbda65ea6bab/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:01.271855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.272481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.272481 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.302008 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] MFA Rules not processed for user `c479530385cc426180b4cbda65ea6bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:01.303218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:01.370458 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1233/2484] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:54:01.375134 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.396071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:01.443993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe074-034f-4469-800e-01d78e8f596c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.448822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.449438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.449735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.450003 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.450660 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.452541 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.482731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1252/2485] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:01 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:01.487152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.498949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb254-4d55-48b8-b676-2cdb2f6d05d7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.547314 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:01.558696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.559302 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.559581 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.559853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.560486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.562541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.584500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1234/2486] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:01 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:01.588803 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.599875 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f41c-4f2d-4f9e-bf1c-7203af0651fe admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.605716 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.606325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.606601 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.606872 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.607509 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.609430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.620661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1253/2487] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:01.625126 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.635566 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5384-c511-4400-8f8b-1e8d285657be admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.640728 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.641391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.641710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.641986 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] PATH_INFO: `/v3/projects/a6ea478e6e234b058b5f93c3b98b1000/users/474e2ef579104703b9b4be212a48f5de/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.657950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ea478e6e234b058b5f93c3b98b1000, user_id=474e2ef579104703b9b4be212a48f5de, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.660635 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.674545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1235/2488] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:01 2022] PUT /identity/v3/projects/a6ea478e6e234b058b5f93c3b98b1000/users/474e2ef579104703b9b4be212a48f5de/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:01.678919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.690021 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb467b7-960c-4f33-a43f-bd5523486795 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.753607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.754205 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.754490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.754806 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.755558 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.757326 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5090cd6-96ef-4949-9f2c-480362edf73b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.768952 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1254/2489] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:01.773145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.785900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57706-a86e-4965-a6e6-b58b85629ef6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:01.792500 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:01.793202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.793527 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.793843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] PATH_INFO: `/v3/projects/a6ea478e6e234b058b5f93c3b98b1000/users/474e2ef579104703b9b4be212a48f5de/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.796212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ea478e6e234b058b5f93c3b98b1000, user_id=474e2ef579104703b9b4be212a48f5de, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:01.799480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:01.811454 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1236/2490] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:01 2022] PUT /identity/v3/projects/a6ea478e6e234b058b5f93c3b98b1000/users/474e2ef579104703b9b4be212a48f5de/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:01.823261 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:01.823570 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:01.823855 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:01.855183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] MFA Rules not processed for user `474e2ef579104703b9b4be212a48f5de`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:01.856511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:01.932172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1255/2491] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:01.944789 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:01.946638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:02.014517 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e77c-c0df-4b8d-b2d2-43304c520b6e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:02.018480 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:02.019093 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:02.019337 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:02.019619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:02.029603 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:02.031063 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be89e5-7c0b-4e72-b682-21277a3465d4 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:02.040883 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1237/2492] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:02.490456 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:02.506714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:02.562179 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5126d-a461-4972-910f-01b5b2a46f74 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:02.567017 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:02.567655 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:02.567933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:02.568203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] PATH_INFO: `/v3/users/c479530385cc426180b4cbda65ea6bab` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:02.569380 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c479530385cc426180b4cbda65ea6bab)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:02.571334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:02.625064 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c479530385cc426180b4cbda65ea6bab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:02.637766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c479530385cc426180b4cbda65ea6bab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:02.651150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c479530385cc426180b4cbda65ea6bab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:02.652368 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c479530385cc426180b4cbda65ea6bab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:02.659944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c479530385cc426180b4cbda65ea6bab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:02.666504 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1256/2493] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:02 2022] DELETE /identity/v3/users/c479530385cc426180b4cbda65ea6bab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:02.671406 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:02.672187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:02.672357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:02.693990 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:02.695449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:02.762384 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1238/2494] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:02.773178 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:02.774699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:02.855911 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dae2c-b83a-4f2e-9728-c5df765e792f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:02.860073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:02.860680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:02.860954 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:02.861195 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:02.870886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:02.872320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:02.882022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1257/2495] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:03.172667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:03.174283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:03.188770 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadec68-4bec-4d8b-9f78-2059f660eb6c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:03.194374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:03.195076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:03.195382 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:03.195740 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] PATH_INFO: `/v3/projects/38f11033b11442afa925a7e89f227a80` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:03.196982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f11033b11442afa925a7e89f227a80)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:03.199553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:03.246223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:03.254214 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f11033b11442afa925a7e89f227a80', 'request_id': 'req-70366b79-1ea1-45ba-b8b2-66053e3afaff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.262999 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f11033b11442afa925a7e89f227a80', 'request_id': 'req-70366b79-1ea1-45ba-b8b2-66053e3afaff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.269023 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f11033b11442afa925a7e89f227a80', 'request_id': 'req-70366b79-1ea1-45ba-b8b2-66053e3afaff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.281309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] The token cache is being invalidate because project 38f11033b11442afa925a7e89f227a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:03.281619 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.282348 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.283921 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1239/2496] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:03 2022] DELETE /identity/v3/projects/38f11033b11442afa925a7e89f227a80 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:03.288117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:03.299111 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5e0c1-6610-4dbb-91de-dadc87cf7eaf service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:03.312373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:03.363983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:03.364529 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:03.364807 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:03.365078 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] PATH_INFO: `/v3/users/474e2ef579104703b9b4be212a48f5de` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:03.366233 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474e2ef579104703b9b4be212a48f5de)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:03.368194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:03.415734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474e2ef579104703b9b4be212a48f5de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.424323 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474e2ef579104703b9b4be212a48f5de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.437955 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474e2ef579104703b9b4be212a48f5de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.438680 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474e2ef579104703b9b4be212a48f5de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.446239 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-92f81d6a-bc3f-4f73-80f8-897eb12d4a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474e2ef579104703b9b4be212a48f5de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.456117 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1258/2497] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:03 2022] DELETE /identity/v3/users/474e2ef579104703b9b4be212a48f5de => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:03.740559 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:03.742176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:03.757811 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366b79-1ea1-45ba-b8b2-66053e3afaff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:03.820909 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:03.821631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:03.821951 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:03.822221 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] PATH_INFO: `/v3/projects/a6ea478e6e234b058b5f93c3b98b1000` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:03.823689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ea478e6e234b058b5f93c3b98b1000)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:03.826184 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:03.879766 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ea478e6e234b058b5f93c3b98b1000', 'request_id': 'req-e39231fd-3f2d-43bd-beef-ecc40c399bbd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.887440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ea478e6e234b058b5f93c3b98b1000', 'request_id': 'req-e39231fd-3f2d-43bd-beef-ecc40c399bbd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.893463 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ea478e6e234b058b5f93c3b98b1000', 'request_id': 'req-e39231fd-3f2d-43bd-beef-ecc40c399bbd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.905034 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] The token cache is being invalidate because project a6ea478e6e234b058b5f93c3b98b1000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:03.905294 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.905992 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e39231fd-3f2d-43bd-beef-ecc40c399bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:03.907483 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1240/2498] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:03 2022] DELETE /identity/v3/projects/a6ea478e6e234b058b5f93c3b98b1000 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:03.912534 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:03.913051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:03.913051 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:03.934263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:03.935483 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:04.006850 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1259/2499] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:04.014970 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.015250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.015529 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.037190 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:04.038435 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:04.047850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1241/2500] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:04.052351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.063307 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c4026-7d4b-4286-97c0-729153cfd4a1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.069252 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.069898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.070176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.070503 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.071198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:04.071468 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.073123 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.085986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1260/2501] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:04.091216 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.103336 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb667a19-4711-4930-b600-6f33badb1a9b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.110681 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.111631 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.112076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.112427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.113289 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.115647 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.152095 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1242/2502] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:04.156472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.166939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc6d3-1d2e-4c7e-a41d-91ee2156afc3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.188443 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:04.229484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.230132 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.230411 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.230685 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.231315 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.233224 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.255824 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1261/2503] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:04.260229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.272652 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a8b6d-2ac9-4f38-a4c8-6de3509faffa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.277978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.278580 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.278854 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.279121 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.279917 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.281540 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.292376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1243/2504] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:04.297071 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.308574 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ac8f8-987b-4ac4-9d0a-8d1d36e0526a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.315251 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.315923 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.316225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.316510 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.317262 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.319097 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d4685-0207-41f0-8c08-688f8c94320c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.329965 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1262/2505] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:04.334188 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.344399 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f250c9-dce0-401a-910a-03936446a383 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.349222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.349902 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.350175 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.350446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] PATH_INFO: `/v3/projects/de0a0dddb54a4e389e576b5c3ce68432/users/4e254f2b4c6d44e9b91e08bb6cda8dad/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.365711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0a0dddb54a4e389e576b5c3ce68432, user_id=4e254f2b4c6d44e9b91e08bb6cda8dad, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.368345 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.371700 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:04.384578 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1244/2506] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:04 2022] PUT /identity/v3/projects/de0a0dddb54a4e389e576b5c3ce68432/users/4e254f2b4c6d44e9b91e08bb6cda8dad/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:04.396640 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090056-7f89-4d89-b86d-874144807326 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.396967 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090056-7f89-4d89-b86d-874144807326 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.397271 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090056-7f89-4d89-b86d-874144807326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.430203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0c090056-7f89-4d89-b86d-874144807326 None None] MFA Rules not processed for user `4e254f2b4c6d44e9b91e08bb6cda8dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:04.431410 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0c090056-7f89-4d89-b86d-874144807326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:04.509167 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1263/2507] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:54:04.514169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.581910 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f330e2-fb1c-458a-aab9-7d0f24c64b77 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.586900 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.587512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.587791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.588059 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.588752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.590733 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.619025 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1245/2508] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:04.623971 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c090056-7f89-4d89-b86d-874144807326 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.636944 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c090056-7f89-4d89-b86d-874144807326 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.699738 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.700244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.700531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.700804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.701439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.703374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.727031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1264/2509] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:04.731376 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.742081 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942522d-f928-4150-9f71-f5bc46657ec0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.747320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.747892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.748176 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.748456 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.749102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.750732 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.762040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1246/2510] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:04.766347 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.777009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e312f9-75bb-4e37-aab6-db6db68a585d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.782010 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.782665 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.782948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.783221 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] PATH_INFO: `/v3/projects/8be0be5cddb54404b91571bd371c6b18/users/d35b37ade49b43419cad6efe591c1677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.799320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be0be5cddb54404b91571bd371c6b18, user_id=d35b37ade49b43419cad6efe591c1677, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.802025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.805118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:04.817048 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1265/2511] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:04 2022] PUT /identity/v3/projects/8be0be5cddb54404b91571bd371c6b18/users/d35b37ade49b43419cad6efe591c1677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:04.821211 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.832326 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4701f-fd49-454e-bee8-f291dd585c38 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.892721 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.893366 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.893690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.893964 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.894637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.896253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02267-e870-4ce5-b8e9-2f3370ff03e7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.907404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1247/2512] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:04.911720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:04.922907 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ae82-9193-4938-9de4-eb6438d83996 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:04.928507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:04.929171 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.929448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.929756 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] PATH_INFO: `/v3/projects/8be0be5cddb54404b91571bd371c6b18/users/d35b37ade49b43419cad6efe591c1677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.931747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be0be5cddb54404b91571bd371c6b18, user_id=d35b37ade49b43419cad6efe591c1677, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:04.934814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:04.946634 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1266/2513] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:04 2022] PUT /identity/v3/projects/8be0be5cddb54404b91571bd371c6b18/users/d35b37ade49b43419cad6efe591c1677/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:04.957693 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:04.957963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:04.958273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:04.993660 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] MFA Rules not processed for user `d35b37ade49b43419cad6efe591c1677`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:04.995097 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:05.053100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:05.072495 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1248/2514] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:05.085219 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:05.087244 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:05.148092 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efe95d-08d0-405c-8a7f-ec956eaf90f3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:05.152549 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:05.153160 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:05.153438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:05.153772 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:05.218419 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:05.219842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:05.229222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1267/2515] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:06.629869 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:06.631413 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:06.643961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1c64-e983-40b1-9f67-15a8b235b673 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:06.647571 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:06.648172 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:06.648447 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:06.648714 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:06.658346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:06.659774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b62603-618f-4187-85f9-cb424dba697e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:06.669541 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1249/2516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:10.485308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:10.552490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e214-9c84-4a48-a26c-e0f9e18388a6 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:10.557502 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:10.558283 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:10.558566 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:10.558846 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] PATH_INFO: `/v3/users/4e254f2b4c6d44e9b91e08bb6cda8dad` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:10.560077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e254f2b4c6d44e9b91e08bb6cda8dad)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:10.562045 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:10.606776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:10.614341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e254f2b4c6d44e9b91e08bb6cda8dad'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:10.623297 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e254f2b4c6d44e9b91e08bb6cda8dad'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:10.637080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e254f2b4c6d44e9b91e08bb6cda8dad'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:10.637817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e254f2b4c6d44e9b91e08bb6cda8dad'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:10.646258 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e254f2b4c6d44e9b91e08bb6cda8dad'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:10.653799 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1268/2517] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:10 2022] DELETE /identity/v3/users/4e254f2b4c6d44e9b91e08bb6cda8dad => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:10.658985 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:10.659520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:10.659520 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:10.680536 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:10.681794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:10.745687 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1250/2518] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:54:10.756638 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:10.758164 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:10.819913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b23d4-fa7e-4457-a793-62f0fb3effd5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:10.824109 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:10.824732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:10.825008 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:10.825281 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:10.834866 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:10.836305 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:10.846939 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1269/2519] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:11.127862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:11.129308 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:11.143551 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14e8b-06f3-4a8c-a997-e9da12ada6d2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:11.148736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:11.149389 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:11.149702 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:11.149947 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] PATH_INFO: `/v3/projects/de0a0dddb54a4e389e576b5c3ce68432` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:11.151316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0a0dddb54a4e389e576b5c3ce68432)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:11.153254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:11.205181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0a0dddb54a4e389e576b5c3ce68432', 'request_id': 'req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.214257 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0a0dddb54a4e389e576b5c3ce68432', 'request_id': 'req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.222168 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0a0dddb54a4e389e576b5c3ce68432', 'request_id': 'req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.235572 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] The token cache is being invalidate because project de0a0dddb54a4e389e576b5c3ce68432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:11.235865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.236593 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.238415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1251/2520] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:11 2022] DELETE /identity/v3/projects/de0a0dddb54a4e389e576b5c3ce68432 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:11.242935 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:11.253118 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50464041-2082-4672-8960-6366715bd3ee service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:11.312933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:11.313597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:11.313885 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:11.314163 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] PATH_INFO: `/v3/users/d35b37ade49b43419cad6efe591c1677` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:11.315337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35b37ade49b43419cad6efe591c1677)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:11.317287 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:11.365826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35b37ade49b43419cad6efe591c1677'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.374036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35b37ade49b43419cad6efe591c1677'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.380037 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:11.390083 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35b37ade49b43419cad6efe591c1677'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.391154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35b37ade49b43419cad6efe591c1677'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.398964 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98b97c38-a965-4402-8aba-785fc872aeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35b37ade49b43419cad6efe591c1677'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.406714 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1270/2521] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:11 2022] DELETE /identity/v3/users/d35b37ade49b43419cad6efe591c1677 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:11.698582 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:11.700274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:11.714436 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9ac6-a32e-4ed3-b18b-f2cb03b148fd admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:11.776705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:11.777231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:11.777509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:11.777809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] PATH_INFO: `/v3/projects/8be0be5cddb54404b91571bd371c6b18` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:11.778980 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be0be5cddb54404b91571bd371c6b18)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:11.780882 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:11.783356 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:11.831589 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be0be5cddb54404b91571bd371c6b18', 'request_id': 'req-c9a98043-e570-4d33-8516-76815e08c1f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.839771 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be0be5cddb54404b91571bd371c6b18', 'request_id': 'req-c9a98043-e570-4d33-8516-76815e08c1f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.845689 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be0be5cddb54404b91571bd371c6b18', 'request_id': 'req-c9a98043-e570-4d33-8516-76815e08c1f0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.857553 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] The token cache is being invalidate because project 8be0be5cddb54404b91571bd371c6b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:11.857878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.858859 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c9a98043-e570-4d33-8516-76815e08c1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:11.860404 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1252/2522] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:11 2022] DELETE /identity/v3/projects/8be0be5cddb54404b91571bd371c6b18 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:11.865668 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:11.866198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:11.866331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:11.886670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:11.887901 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:11.948811 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1271/2523] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:11.957797 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:11.958082 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:11.958352 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:11.978446 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:11.979736 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:11.988661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1253/2524] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:11.993046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.003232 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac34cd-8a66-44bd-8c6f-019951195b3b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.007925 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.008520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.008796 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.009067 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.009757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:12.010115 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.011848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.023757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1272/2525] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 17:54:12.028786 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.038152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851b666-7f06-4b9f-8cf9-5782f1af6dbf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.043042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.043850 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.044181 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.044385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.045044 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.046982 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.081749 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1254/2526] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:12.086139 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.096381 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5721-4aca-4d2a-901a-8fcdcd487f54 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.154747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.155365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.155642 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.155912 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.156543 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.158493 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.181733 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1273/2527] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:12.186245 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.197076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5f5d-2d92-418c-b47f-07ff8fe3c5e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.202841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.203437 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.203745 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.204004 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.204638 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.206284 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.217278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1255/2528] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 17:54:12.221630 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.232047 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dad0d-7ad1-49fd-87bc-8306fd531542 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.238217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.238795 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.239079 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.239341 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.239976 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.241565 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605c117-3903-4a2a-af6c-2fb89d2d0565 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.253068 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1274/2529] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:12.258039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.268897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f802a-e2f2-46a3-b8e6-0ecf7146b0cc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.275040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.275862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.276142 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.276427 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] PATH_INFO: `/v3/projects/39a86940c996442c9a204ac3501b37a1/users/be5c28ed681f410e8e51e59523f86f88/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.292762 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a86940c996442c9a204ac3501b37a1, user_id=be5c28ed681f410e8e51e59523f86f88, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.295380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.309545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1256/2530] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:12 2022] PUT /identity/v3/projects/39a86940c996442c9a204ac3501b37a1/users/be5c28ed681f410e8e51e59523f86f88/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:12.320777 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.321061 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.321330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.350810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] MFA Rules not processed for user `be5c28ed681f410e8e51e59523f86f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:12.352009 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:12.394620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:12.428970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1275/2531] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:12.434171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.503394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c17ee-09c0-4326-be3d-9cac9093d9b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.508509 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.509111 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.509383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.509718 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.510637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.512533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.540253 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1257/2532] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:12.544720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.555589 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ec5d-4073-4b8f-ae40-ea861f63827b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.613168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.613810 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.614087 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.614353 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.615022 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.616921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.639491 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1276/2533] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:12.643753 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.655170 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612b86-bb9b-4e25-9adb-34d7e9952e75 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.660380 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.660976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.661223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.661487 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.662154 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.663743 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.675383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1258/2534] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:12.679921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.690687 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664953d-939b-4def-85cd-caf45a606567 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.695848 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.696506 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.696804 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.697077 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] PATH_INFO: `/v3/projects/f4a1e64ce9324c2285edad8e7c102699/users/6adf52a8f7f14ce9a8289d707463351c/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.713058 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a1e64ce9324c2285edad8e7c102699, user_id=6adf52a8f7f14ce9a8289d707463351c, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.715785 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.729108 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1277/2535] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:12 2022] PUT /identity/v3/projects/f4a1e64ce9324c2285edad8e7c102699/users/6adf52a8f7f14ce9a8289d707463351c/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:12.733273 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.738845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:12.746102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871ff4-5cdb-4980-ba05-3e9d41a6c4dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.809225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.809774 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.810066 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.810324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.810963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.812595 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d177c-a79e-4617-b0a7-2b79488b9dc7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.822488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1259/2536] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:12.827057 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.837699 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fee1-e815-4559-ae1b-c613eb64773d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:12.843391 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:12.844066 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.844338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.844593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] PATH_INFO: `/v3/projects/f4a1e64ce9324c2285edad8e7c102699/users/6adf52a8f7f14ce9a8289d707463351c/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.846586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a1e64ce9324c2285edad8e7c102699, user_id=6adf52a8f7f14ce9a8289d707463351c, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:12.849188 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:12.860595 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1278/2537] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:12 2022] PUT /identity/v3/projects/f4a1e64ce9324c2285edad8e7c102699/users/6adf52a8f7f14ce9a8289d707463351c/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:12.871419 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:12.871719 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:12.871974 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:12.900905 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] MFA Rules not processed for user `6adf52a8f7f14ce9a8289d707463351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:12.902116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:12.973031 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1260/2538] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:54:12.986211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:12.988101 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:13.048486 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24af4f4-50e7-48e3-8c6a-588db6dd26ed admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:13.052507 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:13.053106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:13.053379 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:13.053667 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:13.063338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:13.064681 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:13.074201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1279/2539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:54:13.397305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:13.406950 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2571f3-4d4a-4651-a804-69d013b01624 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:13.412087 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6adf52a8f7f14ce9a8289d707463351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a1e64ce9324c2285edad8e7c102699', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:13.412696 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:13.412981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:13.413255 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:13.413931 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:13.414237 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:13.415846 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:13.428563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1261/2540] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:13.433198 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:13.446867 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaade8-576a-467e-9eb5-4623d8c83e6c service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:13.451784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6adf52a8f7f14ce9a8289d707463351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a1e64ce9324c2285edad8e7c102699', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:13.452400 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:13.452742 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:13.453019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:13.453767 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:13.456225 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:13.488718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1280/2541] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:13 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:13.489994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:13.500819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00751a-04d6-46e3-ab9c-c3434f6ad3a6 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:13.566323 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6adf52a8f7f14ce9a8289d707463351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a1e64ce9324c2285edad8e7c102699', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:13.566939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:13.567223 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:13.567506 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:13.568153 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:13.568459 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:13.570132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:13.582306 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1262/2542] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:13.622616 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:13.633560 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e0f9-f9d1-4d79-96e4-c6e912b72bcb tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:13.638496 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6adf52a8f7f14ce9a8289d707463351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4a1e64ce9324c2285edad8e7c102699', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:13.639124 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:13.639428 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:13.639700 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] PATH_INFO: `/v3/projects/9e084b63ed5e4548bc3c5d5e7d5bddf3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:13.640874 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e084b63ed5e4548bc3c5d5e7d5bddf3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:13.642793 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:13.644430 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:13.692344 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e084b63ed5e4548bc3c5d5e7d5bddf3', 'request_id': 'req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:13.700770 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e084b63ed5e4548bc3c5d5e7d5bddf3', 'request_id': 'req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:13.706731 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e084b63ed5e4548bc3c5d5e7d5bddf3', 'request_id': 'req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:13.719949 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] The token cache is being invalidate because project 9e084b63ed5e4548bc3c5d5e7d5bddf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:13.720230 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:13.720902 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9960bfd7-68ee-409b-a0ed-8f9a89bcee3a tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:13.722422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1281/2543] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:13 2022] DELETE /identity/v3/projects/9e084b63ed5e4548bc3c5d5e7d5bddf3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:13.926690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:13.928663 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:13.935809 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:13.997628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d0f7-3b79-4f6d-8207-5d58c9789c82 tempest-VolumeQuotaClassesTest-1799093258 tempest-VolumeQuotaClassesTest-1799093258-project-admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:14.056052 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:14.056741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:14.057226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:14.057562 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] PATH_INFO: `/v3/users/be5c28ed681f410e8e51e59523f86f88` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:14.058763 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5c28ed681f410e8e51e59523f86f88)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:14.060670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:14.110945 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5c28ed681f410e8e51e59523f86f88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.111747 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5c28ed681f410e8e51e59523f86f88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.119726 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5c28ed681f410e8e51e59523f86f88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.132054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5c28ed681f410e8e51e59523f86f88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.139338 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5c28ed681f410e8e51e59523f86f88'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.145538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1263/2544] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:13 2022] DELETE /identity/v3/users/be5c28ed681f410e8e51e59523f86f88 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:14.150779 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:14.151268 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:14.151374 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:14.171592 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:14.172741 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:14.233919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1282/2545] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:14.243657 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:14.245050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:14.282849 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:14.308744 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f868-47df-4f12-9623-f9cfa841ae1e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:14.312929 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:14.313543 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:14.313874 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:14.314143 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:14.324587 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:14.326145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:14.336486 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1264/2546] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:14.612176 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:14.614797 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:14.633995 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37593-c51d-401c-8f13-94df188b25d3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:14.641986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:14.643476 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:14.643817 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:14.644488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] PATH_INFO: `/v3/projects/39a86940c996442c9a204ac3501b37a1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:14.647024 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a86940c996442c9a204ac3501b37a1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:14.649771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:14.705972 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a86940c996442c9a204ac3501b37a1', 'request_id': 'req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.714876 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a86940c996442c9a204ac3501b37a1', 'request_id': 'req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.720946 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a86940c996442c9a204ac3501b37a1', 'request_id': 'req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.732536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] The token cache is being invalidate because project 39a86940c996442c9a204ac3501b37a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:14.732822 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.733863 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.735438 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1283/2547] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:14 2022] DELETE /identity/v3/projects/39a86940c996442c9a204ac3501b37a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:14.739664 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:14.749724 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e1d3-a7f7-4e25-a1b4-b1eeca2c9abc service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:14.807236 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:14.808037 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:14.808321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:14.808594 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] PATH_INFO: `/v3/users/6adf52a8f7f14ce9a8289d707463351c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:14.809784 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adf52a8f7f14ce9a8289d707463351c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:14.811729 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:14.861212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adf52a8f7f14ce9a8289d707463351c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.861889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adf52a8f7f14ce9a8289d707463351c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.870889 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adf52a8f7f14ce9a8289d707463351c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.883324 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adf52a8f7f14ce9a8289d707463351c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.890461 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bf63c76b-0901-4d64-9882-071848745144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adf52a8f7f14ce9a8289d707463351c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:14.896363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1265/2548] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:14 2022] DELETE /identity/v3/users/6adf52a8f7f14ce9a8289d707463351c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:15.178761 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.180583 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:15.200670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d7bb-c799-4345-aaaf-e1d1240a091c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.214728 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:15.266075 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.266641 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.266919 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.267421 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] PATH_INFO: `/v3/projects/f4a1e64ce9324c2285edad8e7c102699` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.268766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a1e64ce9324c2285edad8e7c102699)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.271254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.323536 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a1e64ce9324c2285edad8e7c102699', 'request_id': 'req-785f57c7-e573-498e-8860-1632f03ec3c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:15.332293 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a1e64ce9324c2285edad8e7c102699', 'request_id': 'req-785f57c7-e573-498e-8860-1632f03ec3c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:15.339086 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a1e64ce9324c2285edad8e7c102699', 'request_id': 'req-785f57c7-e573-498e-8860-1632f03ec3c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:15.350366 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] The token cache is being invalidate because project f4a1e64ce9324c2285edad8e7c102699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:15.350649 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:15.351313 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-785f57c7-e573-498e-8860-1632f03ec3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:15.352829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1284/2549] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:15 2022] DELETE /identity/v3/projects/f4a1e64ce9324c2285edad8e7c102699 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:15.358079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.358994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.358994 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.380076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:15.381283 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:15.431637 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:15.448801 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1266/2550] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:15.514154 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.514513 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.514771 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.536439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:15.537568 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:15.547063 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1285/2551] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 17:54:15.551722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.562286 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454ef4-b60d-4c77-a80e-6d9e3a486c27 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.567203 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.567806 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.568083 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.568357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.568989 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:15.569303 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.570961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.583374 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1267/2552] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:15.588102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.598145 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea3276-9319-4be4-afc3-caadfa5d8562 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.603843 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.604765 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.605042 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.605311 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.605986 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.607898 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.637329 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1286/2553] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:15.641857 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.652588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b36e-6a31-4db4-8b67-3c9ebcd705af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.711705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.712317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.712608 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.712878 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.713683 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.715618 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.741661 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1268/2554] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:15.743191 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.754444 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca798d-c1e8-4cfe-8828-9ce4ab94774b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.760352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.761002 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.761310 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.761651 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.762342 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.764027 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.774798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1287/2555] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:15.779192 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.790225 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695fbb-c136-49e4-bf60-b3a5844c63f6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.795741 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.796370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.796642 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.796913 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.797564 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.799249 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0a0be-e5d8-40e8-99ae-c4d1cd908859 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.810197 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1269/2556] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:15.814805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:15.825389 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddeb72-a620-4748-95bf-8e3c906a333f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:15.830537 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:15.831201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.831480 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.831754 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] PATH_INFO: `/v3/projects/42f5609eff4f464ba6a315441613fb5e/users/f31706ff722a42fc9c9fdf9fc21f5eb1/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.847345 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f5609eff4f464ba6a315441613fb5e, user_id=f31706ff722a42fc9c9fdf9fc21f5eb1, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:15.850073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:15.865306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1288/2557] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:15 2022] PUT /identity/v3/projects/42f5609eff4f464ba6a315441613fb5e/users/f31706ff722a42fc9c9fdf9fc21f5eb1/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:15.876411 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:15.876670 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:15.876949 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:15.907787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] MFA Rules not processed for user `f31706ff722a42fc9c9fdf9fc21f5eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:15.909010 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:15.976246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1270/2558] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:15.981339 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.026299 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:16.048788 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a7ca-d0f3-47e6-a5f0-d74154a63a53 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.053693 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.054298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.054571 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.054838 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.055462 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.057611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.086792 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1289/2559] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:15 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:16.091503 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.103275 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836aab2-0a95-4517-b914-072b0f9b92a1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.151218 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:16.164897 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.165526 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.165835 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.166091 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.166765 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.168707 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.192722 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1271/2560] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:16 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:16.196832 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.207274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe89e4-6082-4f6b-8804-d20a46df0ec2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.211906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.212511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.212782 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.213217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.213970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.215555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.226260 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1290/2561] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:16.230794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.241787 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c902-1ffb-456d-a47e-18f8b66edc6a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.247557 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.248248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.248524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.248794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] PATH_INFO: `/v3/projects/a2a1d21f0d7f490ca9d946288b97b727/users/2433d8b670e741a09b4b76e4605f7645/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.265103 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a1d21f0d7f490ca9d946288b97b727, user_id=2433d8b670e741a09b4b76e4605f7645, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.268077 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.286187 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1272/2562] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:16 2022] PUT /identity/v3/projects/a2a1d21f0d7f490ca9d946288b97b727/users/2433d8b670e741a09b4b76e4605f7645/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:16.292290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.303046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95f771-88fc-4d1e-966c-30be49384040 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.366036 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.366669 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.366978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.367253 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.367906 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.369798 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65c7e5-fe3b-4827-ab42-2f0ce907256e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.379945 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1291/2563] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:16.384405 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.395510 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775f56-5aec-4136-b3c7-0445005f0e00 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.400309 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.401701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.401984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.402252 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] PATH_INFO: `/v3/projects/a2a1d21f0d7f490ca9d946288b97b727/users/2433d8b670e741a09b4b76e4605f7645/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.404212 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a1d21f0d7f490ca9d946288b97b727, user_id=2433d8b670e741a09b4b76e4605f7645, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.406903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.419152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1273/2564] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:16 2022] PUT /identity/v3/projects/a2a1d21f0d7f490ca9d946288b97b727/users/2433d8b670e741a09b4b76e4605f7645/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:16.432834 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.433270 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.433648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.467602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] MFA Rules not processed for user `2433d8b670e741a09b4b76e4605f7645`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:16.468842 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:16.548769 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1292/2565] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:16.559041 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.560939 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:16.624402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b386f-2f3a-4eb7-8ea3-d4a160609ba3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.628322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.628932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.629201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.629464 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.639050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.640554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.652371 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1274/2566] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:16.742783 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:16.756704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a2101-3ca1-4d0c-b06b-3973dfb57613 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:16.761466 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:16.762168 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:16.762439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:16.763070 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:16.804325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:16.839950 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:16.841306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d2d2-6a95-43d0-8436-8a9b8ad19ec1 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:16.852175 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1293/2567] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:21.011171 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:21.075213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253b1d-bd27-4074-9736-22573da2ff79 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:21.079932 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:21.080563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:21.080836 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:21.081101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] PATH_INFO: `/v3/users/f31706ff722a42fc9c9fdf9fc21f5eb1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:21.082378 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31706ff722a42fc9c9fdf9fc21f5eb1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:21.084697 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:21.132668 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:21.134975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31706ff722a42fc9c9fdf9fc21f5eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.135870 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31706ff722a42fc9c9fdf9fc21f5eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.144971 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31706ff722a42fc9c9fdf9fc21f5eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.157477 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31706ff722a42fc9c9fdf9fc21f5eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.164274 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31706ff722a42fc9c9fdf9fc21f5eb1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.170611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1275/2568] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:21 2022] DELETE /identity/v3/users/f31706ff722a42fc9c9fdf9fc21f5eb1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:21.175735 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:21.176238 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:21.176338 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:21.196351 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:21.197805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:21.259851 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1294/2569] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:21.270610 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:21.272165 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:21.332344 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55783-6e96-48e7-ba55-bc49f91d6514 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:21.336213 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:21.336823 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:21.337101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:21.337369 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:21.347132 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:21.348586 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:21.358799 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1276/2570] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 17:54:21.651256 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:21.652957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:21.671717 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea8d4-e089-4946-a88e-e93dc17733fd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:21.678484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:21.679150 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:21.679309 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:21.679734 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] PATH_INFO: `/v3/projects/42f5609eff4f464ba6a315441613fb5e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:21.680755 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f5609eff4f464ba6a315441613fb5e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:21.682921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:21.735226 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f5609eff4f464ba6a315441613fb5e', 'request_id': 'req-fc603911-9aed-474f-8042-ba94beec8956'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.744211 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f5609eff4f464ba6a315441613fb5e', 'request_id': 'req-fc603911-9aed-474f-8042-ba94beec8956'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.750900 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f5609eff4f464ba6a315441613fb5e', 'request_id': 'req-fc603911-9aed-474f-8042-ba94beec8956'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.762621 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] The token cache is being invalidate because project 42f5609eff4f464ba6a315441613fb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:21.762920 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.763540 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.765052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1295/2571] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:21 2022] DELETE /identity/v3/projects/42f5609eff4f464ba6a315441613fb5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:21.769202 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:21.779075 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01872d3-0ca4-4c9c-bd4b-c87d22f0c4c2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:21.838060 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:21.838856 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:21.839129 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:21.839394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] PATH_INFO: `/v3/users/2433d8b670e741a09b4b76e4605f7645` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:21.840545 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2433d8b670e741a09b4b76e4605f7645)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:21.842513 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:21.893764 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2433d8b670e741a09b4b76e4605f7645'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.894746 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2433d8b670e741a09b4b76e4605f7645'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.903386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2433d8b670e741a09b4b76e4605f7645'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.914815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:21.917832 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2433d8b670e741a09b4b76e4605f7645'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.928400 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6e616b2-df0d-4c58-bfa5-f4d64c6d7b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2433d8b670e741a09b4b76e4605f7645'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:21.936297 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1277/2572] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:21 2022] DELETE /identity/v3/users/2433d8b670e741a09b4b76e4605f7645 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:22.219652 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.221193 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:22.235357 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603911-9aed-474f-8042-ba94beec8956 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.296383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:22.303620 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.304582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.304861 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.305409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] PATH_INFO: `/v3/projects/a2a1d21f0d7f490ca9d946288b97b727` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.307653 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a1d21f0d7f490ca9d946288b97b727)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.310254 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.360382 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a1d21f0d7f490ca9d946288b97b727', 'request_id': 'req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:22.368582 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a1d21f0d7f490ca9d946288b97b727', 'request_id': 'req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:22.375845 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a1d21f0d7f490ca9d946288b97b727', 'request_id': 'req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:22.387978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] The token cache is being invalidate because project a2a1d21f0d7f490ca9d946288b97b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:22.388279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:22.388970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c234fdd7-d5a7-4528-ae23-e8652f4c7d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:22.390586 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1296/2573] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:22 2022] DELETE /identity/v3/projects/a2a1d21f0d7f490ca9d946288b97b727 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:22.395794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.396424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.396424 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.417862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:22.419112 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:22.484818 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1278/2574] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:22.492877 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.493105 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.493396 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.513991 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:22.515201 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:22.526072 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1297/2575] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:22.530800 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.541680 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a000-e994-4b16-8b2f-bf19e4113dcf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.547278 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.547845 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.548122 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.548390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.549017 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:22.549322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.550978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.563363 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1279/2576] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:22.568264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.578172 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb7ffc-7b44-43fa-8d2b-3235dca9f524 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.583432 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.584041 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.584320 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.584597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.585243 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.587203 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.617025 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1298/2577] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:22 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:22.621983 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.633039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d69f-12f8-46f2-abd2-92c8ac0d019d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.691626 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.692248 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.692524 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.692793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.693431 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.695391 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.718076 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1280/2578] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:22 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:22.722422 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.734695 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a1a8-6e68-4f5d-b2d4-1467ad8e815a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.740210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.740825 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.741102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.741403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.742103 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.743704 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.754670 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1299/2579] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:22.759201 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.770320 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c49c3-5002-49e3-a8e4-70e28be48e79 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.775296 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.775976 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.776246 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.776512 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.777161 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.778794 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654755d-d824-4729-88d2-2478e95898dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.790231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1281/2580] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:22.794893 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.805454 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4d791-9d7c-4b96-a831-0a75e56c505a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:22.810174 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:22.810829 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.811102 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.811373 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] PATH_INFO: `/v3/projects/ec44257c37c94a599ffdf74ab66ae83f/users/3b4fbc0f813249709e907cd484c4fa6d/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.826956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec44257c37c94a599ffdf74ab66ae83f, user_id=3b4fbc0f813249709e907cd484c4fa6d, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:22.829618 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:22.843751 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1300/2581] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:22 2022] PUT /identity/v3/projects/ec44257c37c94a599ffdf74ab66ae83f/users/3b4fbc0f813249709e907cd484c4fa6d/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:22.855428 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:22.855853 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:22.856238 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:22.888033 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] MFA Rules not processed for user `3b4fbc0f813249709e907cd484c4fa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:22.889228 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:22.932649 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:22.959054 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1282/2582] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:22.970488 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:22.972469 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.033004 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9e05f-08d9-4bd8-aab2-eca19fcd5e90 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:23.037143 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:23.037784 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.038060 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.038308 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.047593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:23.049194 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c1b0-ae1d-4359-8eab-c064fc0919cd service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:23.059330 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1301/2583] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:23.082873 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:23.149865 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc4e43-5a85-411f-a1a2-d7c6a4ecc482 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:23.155409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:23.156050 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.156335 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.156606 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] PATH_INFO: `/v3/users/3b4fbc0f813249709e907cd484c4fa6d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.157864 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4fbc0f813249709e907cd484c4fa6d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:23.159815 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:23.210791 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4fbc0f813249709e907cd484c4fa6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.211452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4fbc0f813249709e907cd484c4fa6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.219100 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4fbc0f813249709e907cd484c4fa6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.231898 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4fbc0f813249709e907cd484c4fa6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.240073 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4fbc0f813249709e907cd484c4fa6d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.246842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1283/2584] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:23 2022] DELETE /identity/v3/users/3b4fbc0f813249709e907cd484c4fa6d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:23.251661 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.252184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.252184 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.273983 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:23.275355 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.297624 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:23.341657 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1302/2585] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:23.351479 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:23.353069 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.411914 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5ba2b-da98-4ebd-8f0d-dba479fdee4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:23.416180 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:23.416539 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.416793 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.417065 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.426922 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:23.428354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d800f0-b6cd-4aab-b4ab-f3ecf46127d0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:23.438396 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1284/2586] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:23.718720 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:23.720237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.732928 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3f87-90fa-4a33-bc43-d51a8d89e349 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:23.738279 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:23.739015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.739349 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.739677 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] PATH_INFO: `/v3/projects/ec44257c37c94a599ffdf74ab66ae83f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.740886 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec44257c37c94a599ffdf74ab66ae83f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:23.742933 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:23.799909 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec44257c37c94a599ffdf74ab66ae83f', 'request_id': 'req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.808257 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec44257c37c94a599ffdf74ab66ae83f', 'request_id': 'req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.814365 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec44257c37c94a599ffdf74ab66ae83f', 'request_id': 'req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.826776 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] The token cache is being invalidate because project ec44257c37c94a599ffdf74ab66ae83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:23.827321 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.828149 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c73d165-5b38-4ac4-9989-0b3ef2e0bcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:23.830052 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1303/2587] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:23 2022] DELETE /identity/v3/projects/ec44257c37c94a599ffdf74ab66ae83f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:23.835293 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.835585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.835862 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.844360 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:23.859114 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:23.860333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.925383 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1285/2588] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:23.935433 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.935676 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.935977 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.957001 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:23.958274 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:23.967106 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1304/2589] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:23.972325 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:23.983279 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c4dbe-4598-4ebf-93f6-0fc19af2ea7f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:23.989390 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:23.990039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:23.990316 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:23.990584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:23.991231 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 17:54:23.991533 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:23.993173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.006130 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1286/2590] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Oct 17 17:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 17:54:24.011325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.020853 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb5acd-1b25-4a87-955a-0dfc2fc968a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.026031 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.026732 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.027015 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.027290 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.027936 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.029862 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.060237 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1305/2591] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:24.064734 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.076365 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add590-328d-4204-8db7-b18c20adb494 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.138276 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.138892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.139164 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.139426 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.140064 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.142042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.165409 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1287/2592] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:24.169970 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.181181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7634-ad75-4a6b-bd26-68ecbb732f15 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.187598 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.188264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.188597 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.188913 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.189623 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.191301 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.202895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1306/2593] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:24.207584 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.218711 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ae46-99c6-44a4-8a22-fe9d31b8aabc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.223579 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.224229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.224485 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.224752 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.225418 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.227057 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ec46-8765-4a5f-b31d-ad52612107cd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.238757 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1288/2594] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:24.243352 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.255222 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475d98-745e-445d-a93e-241a12438f1d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.261484 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.262264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.262575 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.262980 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] PATH_INFO: `/v3/projects/8acf43e558e84388a0e4ac74702c170c/users/50f2675c48b348ad9c1a9e4b267bdb89/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.279988 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acf43e558e84388a0e4ac74702c170c, user_id=50f2675c48b348ad9c1a9e4b267bdb89, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.282727 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.297819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1307/2595] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:24 2022] PUT /identity/v3/projects/8acf43e558e84388a0e4ac74702c170c/users/50f2675c48b348ad9c1a9e4b267bdb89/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:24.309160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.309440 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.309760 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.339888 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] MFA Rules not processed for user `50f2675c48b348ad9c1a9e4b267bdb89`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:24.341182 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:24.403867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:24.413313 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1289/2596] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:24.414544 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.465625 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:24.487864 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca4ad-2954-4bb6-ab0e-52e92a20aa4c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.493152 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.493805 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.494140 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.494451 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.495093 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.497028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.525889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1308/2597] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:54:24.530673 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.543628 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d826be-3946-4df7-8f2a-8aba88d40784 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.606449 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.607071 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.607347 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.607646 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.608301 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.611230 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.640855 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1290/2598] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:24.645263 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.656336 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6844-8be8-4ef9-8e42-40d6d55ddf2b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.661278 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.661914 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.662217 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.662490 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.663136 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.664724 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.676094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1309/2599] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:24.680385 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.690887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc9d7e-c600-4cbc-9262-e31a71af6133 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.695963 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.696575 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.696852 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.697124 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.697879 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.699498 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393712c-2370-4d8d-ba50-a30a649aea03 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.710178 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1291/2600] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:24.714859 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.725429 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ebb2-339a-46c2-b93e-9d91dd1f6162 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.730747 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.731401 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.731678 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.731953 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] PATH_INFO: `/v3/projects/033a4c59740c49fdbf550068a59f27af/users/bbbea499d2ca41669fbfce3359b241bc/roles/0cf9dc9265e6464b9f4900be70acd315` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.747607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=033a4c59740c49fdbf550068a59f27af, user_id=bbbea499d2ca41669fbfce3359b241bc, role_id=0cf9dc9265e6464b9f4900be70acd315)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.750318 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.765478 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1310/2601] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:24 2022] PUT /identity/v3/projects/033a4c59740c49fdbf550068a59f27af/users/bbbea499d2ca41669fbfce3359b241bc/roles/0cf9dc9265e6464b9f4900be70acd315 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:24.776039 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.776321 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.776590 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.807096 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] MFA Rules not processed for user `bbbea499d2ca41669fbfce3359b241bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:24.808394 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:24.874819 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1292/2602] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:24.879448 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.942439 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08911-dc5c-4037-b8cf-780d2c3401ec admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:24.947125 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:24.947718 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:24.947996 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:24.948264 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:24.948897 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:24.950814 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:24.979403 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1311/2603] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 17:54:24.983995 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:24.995462 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fed980-5948-41c6-8038-17bba451e0e7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.054690 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.055305 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.055588 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.055867 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.056490 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.058958 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.070217 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:25.086116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1293/2604] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Oct 17 17:54:24 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 17:54:25.087445 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:25.099189 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ddc0b-05b2-43e8-8c36-8b85fcf53569 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.106034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.106766 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.107065 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.107334 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.107981 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.109921 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.121729 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1312/2605] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:25.126042 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:25.136705 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190e41-2bf3-4b94-895d-7f0d8004bdf5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.141908 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.142554 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.142840 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.143079 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] PATH_INFO: `/v3/projects/96ad3723c6844b9498484815aa44e376/users/b193c1ea638546f8b2f9cd33c5ab76c9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.158386 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ad3723c6844b9498484815aa44e376, user_id=b193c1ea638546f8b2f9cd33c5ab76c9, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.161068 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.174667 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1294/2606] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:25 2022] PUT /identity/v3/projects/96ad3723c6844b9498484815aa44e376/users/b193c1ea638546f8b2f9cd33c5ab76c9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:25.179129 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:25.189628 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4004a4-cd04-465a-868c-fff84eacc3cc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.250511 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.251033 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.251331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.251600 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.252235 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.253889 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496ae95-2ddf-4163-a39e-b91f14234430 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.264325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1313/2607] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Oct 17 17:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 17:54:25.268703 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:25.279930 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a734f-510e-4d58-bbc3-62c7fb3e812e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.284515 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.285173 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.285451 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.285761 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] PATH_INFO: `/v3/projects/96ad3723c6844b9498484815aa44e376/users/b193c1ea638546f8b2f9cd33c5ab76c9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.287710 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ad3723c6844b9498484815aa44e376, user_id=b193c1ea638546f8b2f9cd33c5ab76c9, role_id=7b2ce1f7ca404501900e0e4e4ca8f7d7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.290410 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.301177 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1295/2608] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Oct 17 17:54:25 2022] PUT /identity/v3/projects/96ad3723c6844b9498484815aa44e376/users/b193c1ea638546f8b2f9cd33c5ab76c9/roles/7b2ce1f7ca404501900e0e4e4ca8f7d7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 17:54:25.313073 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.313331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.313737 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.329162 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:25.345282 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] MFA Rules not processed for user `b193c1ea638546f8b2f9cd33c5ab76c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:25.346547 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:25.419757 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1314/2609] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:25.432040 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:25.434116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:25.497101 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c73029-7f8e-4e3a-a8ec-829126f5d828 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:25.500978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:25.501538 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:25.501842 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:25.502116 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:25.563145 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:25.564611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:25.574169 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1296/2610] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:27.104402 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:27.106034 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:27.119775 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fdea5-58f5-4440-b83c-0e4d7b5cad73 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:27.123820 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:27.124425 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:27.124707 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:27.124978 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:27.183472 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:27.185006 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:27.194383 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1315/2611] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:27.753290 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:27.763055 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa30e6-0f4e-48a1-b34f-5a1da39bc360 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:27.766984 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb97ad1bfae943289b1b967065937396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:27.767623 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:27.767933 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:27.768250 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:27.777903 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:27.779333 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91610b8-e5fe-4b64-bfbf-50ba7a65d43b service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:27.788978 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1297/2612] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:31.729298 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:31.795306 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908ced-6dc7-40a1-b5e0-c213ab091e72 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:31.800312 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:31.800948 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:31.801227 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:31.801499 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] PATH_INFO: `/v3/users/50f2675c48b348ad9c1a9e4b267bdb89` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:31.802671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f2675c48b348ad9c1a9e4b267bdb89)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:31.804593 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:31.842394 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:31.856367 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f2675c48b348ad9c1a9e4b267bdb89'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:31.864406 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f2675c48b348ad9c1a9e4b267bdb89'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:31.878147 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f2675c48b348ad9c1a9e4b267bdb89'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:31.878915 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f2675c48b348ad9c1a9e4b267bdb89'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:31.886956 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f2675c48b348ad9c1a9e4b267bdb89'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:31.893520 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1316/2613] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:31 2022] DELETE /identity/v3/users/50f2675c48b348ad9c1a9e4b267bdb89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:31.898312 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:31.898834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:31.898834 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:31.918370 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] MFA Rules not processed for user `9fdce8f8b50f420382f53907829ee9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 17:54:31.919563 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:31.971354 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:31.981058 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1298/2614] 10.222.0.62 () {58 vars in 958 bytes} [Mon Oct 17 17:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 17:54:31.991080 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:31.992726 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:32.052325 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a579f6e-8e3f-4098-81a5-d46491097194 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:32.056212 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d909083488f4a8c9ef7bd628c801950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:32.056819 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:32.057094 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:32.057552 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:32.067409 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:32.068854 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:32.079046 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1317/2615] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:54:32.366098 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:32.367585 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:32.381887 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d1c1-0740-429c-b58a-951c7d5ad5a1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:32.387892 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:32.388692 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:32.388972 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:32.389961 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] PATH_INFO: `/v3/projects/8acf43e558e84388a0e4ac74702c170c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:32.397300 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acf43e558e84388a0e4ac74702c170c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:32.399357 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:32.452322 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acf43e558e84388a0e4ac74702c170c', 'request_id': 'req-a36e80b8-f5be-4548-9632-4f8951cae797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.460574 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acf43e558e84388a0e4ac74702c170c', 'request_id': 'req-a36e80b8-f5be-4548-9632-4f8951cae797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.466975 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acf43e558e84388a0e4ac74702c170c', 'request_id': 'req-a36e80b8-f5be-4548-9632-4f8951cae797'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.479229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] The token cache is being invalidate because project 8acf43e558e84388a0e4ac74702c170c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:32.479229 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.479641 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.481226 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1299/2616] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:32 2022] DELETE /identity/v3/projects/8acf43e558e84388a0e4ac74702c170c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:32.486014 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:32.496826 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936f4c-1b43-487f-9b74-6f0b224b660a service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:32.557210 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:32.557890 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:32.558170 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:32.558442 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] PATH_INFO: `/v3/users/bbbea499d2ca41669fbfce3359b241bc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:32.559648 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbea499d2ca41669fbfce3359b241bc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:32.561602 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:32.611555 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbea499d2ca41669fbfce3359b241bc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.620019 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbea499d2ca41669fbfce3359b241bc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.621691 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:32.635966 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbea499d2ca41669fbfce3359b241bc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.636702 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbea499d2ca41669fbfce3359b241bc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.643828 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbea499d2ca41669fbfce3359b241bc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:32.649993 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1318/2617] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:32 2022] DELETE /identity/v3/users/bbbea499d2ca41669fbfce3359b241bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:32.941658 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:32.943222 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:32.957611 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e80b8-f5be-4548-9632-4f8951cae797 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:33.020152 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:33.020701 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:33.020981 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:33.021254 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] PATH_INFO: `/v3/projects/033a4c59740c49fdbf550068a59f27af` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:33.022402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033a4c59740c49fdbf550068a59f27af)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:33.024317 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:33.075146 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033a4c59740c49fdbf550068a59f27af', 'request_id': 'req-a061ee6e-de2b-4e82-9c71-340f0108d290'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.083640 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033a4c59740c49fdbf550068a59f27af', 'request_id': 'req-a061ee6e-de2b-4e82-9c71-340f0108d290'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.090056 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033a4c59740c49fdbf550068a59f27af', 'request_id': 'req-a061ee6e-de2b-4e82-9c71-340f0108d290'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.101901 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] The token cache is being invalidate because project 033a4c59740c49fdbf550068a59f27af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:33.102193 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.102843 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.104841 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1300/2618] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:32 2022] DELETE /identity/v3/projects/033a4c59740c49fdbf550068a59f27af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:33.109337 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:33.111265 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:33.124836 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7aed-7ebc-4f37-b170-6a97b26a4804 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:33.185200 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:33.185895 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:33.186156 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:33.186434 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] PATH_INFO: `/v3/users/b193c1ea638546f8b2f9cd33c5ab76c9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:33.187607 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b193c1ea638546f8b2f9cd33c5ab76c9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:33.189531 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:33.241303 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b193c1ea638546f8b2f9cd33c5ab76c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.250611 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b193c1ea638546f8b2f9cd33c5ab76c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.265183 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b193c1ea638546f8b2f9cd33c5ab76c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.265975 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b193c1ea638546f8b2f9cd33c5ab76c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.273831 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b193c1ea638546f8b2f9cd33c5ab76c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.280113 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1319/2619] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Oct 17 17:54:33 2022] DELETE /identity/v3/users/b193c1ea638546f8b2f9cd33c5ab76c9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:33.570522 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:54:33.572342 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:54:33.588415 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061ee6e-de2b-4e82-9c71-340f0108d290 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:54:33.599499 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:33.662452 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fdce8f8b50f420382f53907829ee9fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a760cc568b8d4fdf85c6c5d207733585', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:54:33.663102 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:54:33.663402 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:54:33.663691 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] PATH_INFO: `/v3/projects/96ad3723c6844b9498484815aa44e376` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:54:33.664918 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ad3723c6844b9498484815aa44e376)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:54:33.667699 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:54:33.723160 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ad3723c6844b9498484815aa44e376', 'request_id': 'req-1daa26aa-c364-4484-8e00-8bcaee39529e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.732244 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ad3723c6844b9498484815aa44e376', 'request_id': 'req-1daa26aa-c364-4484-8e00-8bcaee39529e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.739393 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ad3723c6844b9498484815aa44e376', 'request_id': 'req-1daa26aa-c364-4484-8e00-8bcaee39529e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.751785 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] The token cache is being invalidate because project 96ad3723c6844b9498484815aa44e376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 17:54:33.752078 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.752756 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1daa26aa-c364-4484-8e00-8bcaee39529e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 17:54:33.754346 dv-cinder-861609-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1301/2620] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Oct 17 17:54:33 2022] DELETE /identity/v3/projects/96ad3723c6844b9498484815aa44e376 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 17:54:43.276781 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:43.748488 dv-cinder-861609-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:54.284458 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 17:57:54.286181 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:57:54.365273 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127b82-7885-46ab-b9a8-f64c2d6c4ae0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 17:57:54.428740 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8a289b1980346cc89cd56154b8c32fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42c02dd9a0e2458896aea742a1ec9a39', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 17:57:54.429359 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 17:57:54.429671 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 17:57:54.429957 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 17:57:54.432137 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 17:57:54.444646 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 17:57:54.446331 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c8e3-1aa3-4688-b804-d4eb3b258362 service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 17:57:54.458028 dv-cinder-861609-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1320/2621] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Oct 17 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 17:58:04.453234 dv-cinder-861609-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=58 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}